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KECOGNlTlflN OF TOPOLOGICAL IHVAR IAHTS+ 
BY ITERATIVE ARRAYS 

Abstract 

A study ia made of LIim i-u c wgni t ion and transformation of figures 
by iterative arrays of finite state automata, A figure is a finite 
rectangular tuo-d linens iOnal array of symbols. The iterative arrays 
considered are also finite, rectangular, and two-din*ensiOnal. Hie 
automata comprising atiy given array are called cells and are assumed 
to be isomorphic and In Operate synchronously with the state of a cell 
at time t+1 being a function of the states of it and its four nearest 
neighbors at time t. At time t-0 each cell ta placed In one of a fixed 
number of initial states. The pattern of initial States thus intro- 
duced represents the figure to be processed!. The resulting sequence of 
array states represents a computation based on the inpuc figure. If 
one waits for a specially designated cell to indicate accept ance or 
rejection of the figure, the array is said to be working On a recog- 
nition problem, if Que w*its for the array to come to a stable config- 
uration representing an Output figure, the array is said: to be working 
on a trans- formation problem. 

Chapter 2 contains 4 general theory of recognition r Therems on 
the amount of time required to perform recognition and on methods of 
speeding qp recognition are presented, Some properties of tha classes 
of recognisable figures are given. Arrays are tOmpared to other types 
of figure recognition devices, In the last ««cticm the class of linear 
predicates is studied, A linear predicate is a family of figures which 
can be recognized in time proportional to the perimeter of the figure. 

Chapter 3 contains a study of the recognition of some to polemically 
invariant properties of figures. A f uudaeftental transformation of 
figures 1b presented and is then used to show that a wide variety of 
topolcglcally invariant properties form linear predicates including 
connectivity and miti solvability. Two properties whose linearity is 
open are discussed. 

Chapeter k contain* a brief study of transformation problenw. Some 
general theorems are presented as wall aa discussions of specific 
trans-format ions , An optimal, solution to the two-- dimensional firing 
squad synchronisation problem is also presented in Chapter A. 

In addition to the formal results* several open questions are 
presented and some iterative- programming techniques are considered. 



«rtiia report reproduces a thesis of tha same title submitted tv the 
iJepartiuttiL <?* Mathematics, ttaeeacbusette Institute Of Technology, in 
partial fulfillment of the requirements for the degree of Doctor of 
Philosophy, 
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CHAPTER 1 
IHTRDUJCTIOT 

1.1 The Topic 

In this thesis we study th* recognition and transformation of 
figures by iterative array a of finite state autouata* For our 
purposes a figure is a finite rectangular iwo-diise.isionil array of 
symbols, air iterative arrays are also finite, rectangular,, and 
^wo-dimen signal, We call the automata i which stake up such an array, 
calls* All the call* in ar. array are assuned to be of the sane typo, 
that is* isonorphie, rhe calls on "the edges and corners of an array 
may operate- In a manner quita distinct from tnose in the interior, 
but this is to W thought &f a a an effect which takes place Because 
these calls can sense that they are an the edges rather than because 
they are inherently different from the interior cells. All of the 
calls are placed in the array with cooaon orientation and each c&ll 
is connected to its four nearest neighbors, the array functions 
synchronously, with the state of each call at time t + 1 being a 
function of the states of it and: its four nearest neighbors at time t* 

At time t = Q we place each cell in swne initial state* The 
CoeflpiratiiSn of initial states thus introduced represents a figure 
which is taken to be the inpai to the array .. Given an input figure* 
the array proceeds froai state tc state with the state transitions of 
the array being determined by the transition function of the call 
type from which the array was constructed. The progression of array 



EtiUjS may be interprete j as a computation, based on the input figure, 
Of the many interpretati uns possible, we will consider two which W* 
CSi?. recognition and display. 

In a recognition computation we ?iew the array as ah acceptor 
of figures in much the same way that a finite state automaton raay be 
viewed as an acceptor of tapes. Two cell states as* designated as 
final abates corresponding to accept and reject. These states are 
assumed tc be terminal. We input a figure j allow the computation 
to proceed* and observe some Specially designated cell, aay the 
northwest ccmer cell. When that cell enters one of the two final 
states* we eay that the figure has been accepted or rejectsd. 

In a display canput^.tiSn w«j view tine amy as a device for 
perfoniing' a transformation of the input figure* Certain cell States 
are Cfealgnated fla final states and arc assumed to te terminal, we 
input a figure „ allow the computation to proceed, and observe the 
array until it enters a state in which each cell is in a fitval state ■ 
We interpret the resulting configuration of final states as a figure 
and take that figyre to be the output of thr_; conip-itation. 

The major portion of this thesis is devoted to the study of 
recognition. A central role in this study Is played by the concept of 
predicates which are simply collections of figures. Usually the 
figures comprising a particular predicate share seme common property 
union ia of interest* Given a particular predicate and a cell type* 
ue say that the cell type recogniies the predicate if the arrays of 
that type accept exactly those fibres belonging to the predicate 
and reject all others. We consider questions such as the following; 



"Whit may be said about the dags of predicates which 

are recognisable by arrays?* 

"What may be said about the spied with which a given 

predicate can be recc^-jed? 1 * 

"How powerful are arrays ag recognition devicesT" 1 

"To what other devices may they be oaaparedr" 
A Kodest theory of recognition is developed in an attempt to answer 
these and other questions. In addition the application of array* to 
son* specific re cognition, problems is considered. These problem* 
•nniuie tne rscocnition of connectivity, simple connectivity* and 
more complicated, topological ly invariant predicates* Display problems 
arc treated briefly in a cwi eluding Chapter* 

T»£ Ihe Background 

One of the earliest uses of lte rattle arrays was by von Neumann 
who used the structure of a regular array of identical automata as the 
framework for a study of self-reproducing a-j^oroata. The ven Neumann 
manuscript ha 3 been edited and Completed by Bwks * 

Hennke 11 ' has performed" an extensive analysis of the functioning 
of iterative arrays in several dinansions. In his voi-k arrays are 
cl^.s si-Fled according to the number of tfimensions , the number of 
directions of signal flow T and whether or not the cells have an internal 
memory. h"ennie l 's cells are equipped with external input and output 
lines. Figures are p^senxed t; the array by placing an appropriate 
stimulus on each Input line and maintaining the stimulus until an 



*- L pnroariatfr output ta obtained. He does net always assume that the 
cells have been reset to a canonical stats at the tine tha Input is 
.■Ft* aunts d. Thus a given input figure Bay <.ause different behavior in 
the array depending en the configuration of states at the ti*e the 
input was presented* If an array always achieves a steady state no 
natter what ite initial configuration and input, it is said to be 
stable* If an array has exactly ono ataady state corresponding to any 
given input* it is said to be regular. Heruiie studies the question 
■>f determining the stability or regularity of a family of arrays* 
LTiveii a description of a typical cell* He finde algorithms Tor 
.■j-.werir.^ these quart! DBS in BLOSt one-diman si anal cases and goes Oft to 
show that the game questions 4 re recursively un solvable in higher 
dinensions under all but the Host severe restrictions on signal flow* 
Ha also studies the relative computing power of arrays or various 
'WP&f* Many of the questions studied by Kennis deal with arrays par 
ae as opposed to the application of arrays to computation*^ problems. 
Since we tend to emphasis a the latter type of problem 1 we feel that 
our work fores a conpZapent to that of Hannie, 

Many people are introduced to iterative arrays via the c^e- 
diiieneioaal firing squad synchronization problem. This problem has 
i»en credited to John Myhill 096?) by Moone^ 1 ^. Solutions of 
varying degrees of efficiency and generality have been published by 
WaksRan^ 1 ^, Haizer^, and Moore and LlngdOti ^ + The two- 
disensional firing squad is discussed in Section 4.3 below. 

The real time computing power of iterative arrays has oean studied 
by Cola^. Atrubin^, and Fischer ^'. In their medals, one Cell 



of the array is equipped with Input and QU'.put channels. A time 
sequence nf inputs is fe-:L into this coll aijd a computed output sequence 
la tpxodjjced, Arrays are thue viewed its another form of sequence 
transducer. Atrubin snows that -nultiplicatiom of two Miliary coded 
num^jers may ba performed in real tijae by an infinite one -difrien si Onal 
array. Fi^ctiEr shows th.it an infinite onB-dinensiooal array can 
genor EtE the characteristic function of the set of prigae integers In 
real tifl*. Cole performs extensive studi»a of the real-time 
computational powers of infinite iterative arrays in arbitrary 
dimensions. He establishes relations between the real-tiro computing 
power of such arrays and tne information capacity of the inter-cell 
connections. Ifra use of arrays as figure computers is not considered 
In these papers. 

The use of arrays to process two-dimer.sicr.al figures has been, 

(1) 

considered by Atrubin who analyses several ejamplas of simple 

figure transformations, but xakes no attempt to formulate a general 
theory* 

Hany algorithms for serial computers have been published which 



find a natural Batting in iterative arrays* Examples are the shortest 

Lh metbe< 
PiW ,ft \ 



path metbcd Of L*e^ ' and the picture prase Bsing of Rc-senfeld and 



The review of highly parallel computers by MurthV J * contains 
the designs of many theoretical and actual computers which Incorporate 
regular arrays of identical processing elements, Among those discussed 
we night aention the "spatially Orients d* computer of Unger^' and 
the ItfJAC 17 described by Barnes^, 



Our work has been greatly influenced by the work of Ml^stey and 
Papert^"' on the perceptrofl.. In their boo* thsy state: 

"Good" theories rarely develop outside the context of a 
background of well -understood real problems and special 
cases* * * * Accordingly, our best c<iurse would seen to 
be to strive for a very thorough understanding of well- 
chosen particular situations in which "hese- concepts 
(parallel* gerial* etc*) are involve!* " 
This thesis is an attempt to analyse a special case of parallel 
processing in the same spirit and in a manntr compatible with that 
of ^insky and Fapert* 

1.3 The tJtyooit 

Chaster 2 contains a general theory of recognition. After some 
basic definitions ,. an sxampla of the solution of a recognition problca 
is given. Next th& amount of time required for the solution of 
recognition problens is taken up. Vrt give the Interdependence Theorem 
which allows us to predict the future state of a celit given sufficient 
information about the current states of it and its neighbors* The 
Interdependence Theorem is used to establish lower bounds on tie 
recognition ti»e of most predicates and is also the basia of the 
Speecl-Up Theorem* An adaptation of a well-known iterative technique, 
the Speed-Up The Oram state* that if recognition can t« carried out by 
an array within time T(m,n) where the array is of siae mjrn* then 
for any Integer k a second array can be constructed which wiii carry 



'*■ 



out the Computation within ulma - -T{a. w B.) + a. + n + 2, Finally we 
haTe the Miniaiaing Theursa* which say g that two distinct authods or 
^nc-pitiing a predicate: »ay be combined tc obtain a method which is is 
fast -on any figure as tha- faster of the two, 

-ITnipter Z continues with a study af the earaput in g power of 
array a , We find that arrays are not universal compute ra, but are nor* 
powerful as figure reCetniiMrs than the pebble automata cf aiun and 
KewitV^, In fact, arrays are equivalent in power to» although 
faster than, linear bounded automata which are allowed to walk about 
on a fifui-e. This eo/jl Valance was to ba Expects d since the amount of 
storage available to an array increaaas linearly with the siia of the 
figure* "j*.'b show that the class c-f recognisable predicates forms a 
^ooiean algebra. Sane ^decidability results *na obtained including 
the undtcidaoi-ity of whether or not a given ceil type recognizes a 
given predicate* 

Chapter Z finds with, a brief study of the class Of linear 
predicates {those which are recognisable in time proportional ta the 
perimeter of the array). It is shown that a linear predicate la T in a 
certain "Hell-defined sense, recognizable almost as fast as any 
pnedioate* Tnis fact is interesting because it is showr. in Chapter 3 
that some intuitively very c explicated predicates are linear. The 
class fj£ linear predicates is shown to be a Boolean algebra and soae 
unsolvable problems are presented. Finally we discuss the open question 
of whether or not all recognisable predicates are linear. 

Chapter J eontaijis a st*tdy of soma tapclnjjically invariant 
predicates (predicates over Olack and white figures which depend Only 

11 



on the manner In which the holes and components of the figures are 
embedded Within Safin Other). W* first develop a simple but Yery 
powerful transformation of figures called tne connectivity transforma- 
tion. U^ing this transformation as a basis* we prove that a wide 
Variety cf predicates including ■connectivity" and. "simple connec- 
ti.iri.ty" are linear. It is shown that it can be determined whether or 
act a ^ae* is solvable in less time than is inquired for the trans- 
mission cf a signal along the shortest path 0- the maze. The problems 
of •iolvzsg zu-ti-svel mazes ami developing a three-dimensional 
connectivity transformation are discussed. It is shown that the 
solution in linear time of multilevel maies would iaply that any 
predicate recognizable by a finite state automaton was linear* 

Chapter 4- contains a brief description of the us* of arrays in 
display problems and presents some typical figure transformations 
which may be carried Out. Several open questions are presented* 

Throughout the thesis many open questions are raised* These 
questions may be referenced by looking in the Index under "open 
questions »* 

In addition to the formal results obtained* we have included 
discussions of se-ve-ral irvterative programming techniques. These 
techniques were developed to solve specific problems, but are of 
general interest* They nay be found by looting in the indB* under 
" programing te chnique a * H 
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CHAPTER 2 

THEORY or aECOOHITSOM 

In this chapter we will, formalize th* notion of iterative array 
and atudy aona aspects cf the theory c*£ the recognition of figures by 
iteratlY-j arrays, 

£*1 Basic Daflnitians 

Consider a flait*, rectangular, two-dimensional iterative array 
*f finite state automata. Such an array is pictured below with the 
automata represented by square a t The lines connecting the squares 
represent ec«municatian channels between the automata. 




^b automata used in such a construction are called cells and 
the entire arrangement Is Called an iterative array or simply an 
agray , Othflj- teme used in th* literature include ""cellular array" 
and 'iterative array cf logical circuit a," We assume that all of 
the cell 5 In the array are isomorphic and have bean placed i^ the 
array with comnon orientation, Bach cell is connected -with its 
four nearest neighbors. The array functions synchronously with the 
state of a cell at time t + 1 bainp a function of the states of it 
and Its four nearest neighbors at tine t* 

13 



The above description assumes that every cell In the array haa 
four nearest neighbors *hil* in th* diagram It appears that the eells 
cxv ^ie edges and comers of th* array have fewer than four. He ha to 
her* a conflict of interest. Cr. the one hind we would like to be able 
to treat all the rails as if they Kara Lhe saunft r allowing us to make 
statements such as "All Colls ar* isomorphic n and "2ach qell is 
connected to its four nearest neighbors* 11 Cn the other hand we 
definite-y want to make US* of the fact that the cells on the edges 
and corners can operate in a manner different froffl those in the interior. 
Fortunately these tvc point 9 of view can be resolved by a sirapl* 
technical device* Infernally v* will eontinue to think of an array 
as a f+nvbe rectangular nrranije-fflerit c-f ceUs. Formally, however, wo 
vill jxiciuna this finite array cf cells as bain^ embedded in A two-way 
infinite cellular apace* JU-1 c-f the cells in this space which are not 
within the finite array will be in a special terminal state* e* called 
the ed&e 5 late » Thus the Only real competition within the apace takes 
place within -Jnat finite portion known as 'J-.e array. Any cell in the 
array car, determine where it lies with respect to *tie boundary of the 
array by dote raining which of its neighbors ar* in edge states .. Thus, 
for eicaJBpl*, the nflrthwest corner Cell of the array car- operate in a 
Banner whiph is couple taly unlike any other eftll in the array and yet 
we can consider it to be isomorphic with all other cells in the array* 
Th* description of a "typical" coll in an array xust actually describe 
the behavior Of that call in each of the sixteen possible positions in 
which it can find itself with respect to the boundary of an array. 

For the sake Df simplicity we will emit from our diagrams all 

14 



calls wh^ch do not lie within the array ana will suppress the lines 
indicating intercell connections* Our diaeram, now becoass siaplyt 



1 1 

i m-u ^^m ^^^ ^^^ ^b^ ^..^b. 

1 

_ __ ^__j , i 



Sinse the calls which dD not lie Within the array are always in 
state e» we seldom hare to mention them explicitly. NeTertheiess they 
are tacitly assumed Zo ba present at, all tuEes» 

To operate an array as a recognition device for black and while 
figures, one designates two of tha call's states -o be initial ata^es 
c or i-a spending to bUck and white. At tiwe t ■ every c*il in tha 
array la placed in one of the two initial state 8 and the pattern of 
states thug a reaped represents the figure to be processed. Beginning 
with the initial state representing the figure t the array proceeds Iron 
stat* to state until finally a designated call [we will always use the 
northwest corner call) enters one or the other of two specially 
designated final states thus indie* tin £ Whether toe figure ha? been 
accepted or rejected* The final stages are assumed to be terainal, 
Kete that w* use only one accept state rather -liar, many, The *se of 
f< single terminal accept Stat* is r.orely a technical cor.vAr.i ftnce and 
causes no loss of Rene re ] -L ty* 3y using the techniques of Theorem 2.5 
below, any cell type with multiple non-terminal, accepting states tan be 
cc-hYerted into a cell type with a single terminal accept state* 

An array operating in the mode described in the preceding 
paragraph is said to be working on a ragoctition PTQbl«u Th» 
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ejcteniicu of ra cognition problems to indole input figures of tor* tian 
t*o colons and to n-vay classification rat] lot than binary classification 
is straight forward* 

^he-ae informal remark a motivate the fallowing definition. 

Definition 

A cell type H is a 5-tuple (S,I,F.aif} where 

5 is a. finite sot of cell s tates ; 
I Is a ambaet of 5 called the JJliU.SU atataa : 
T 1b a aubaet -or S Called the f\nal states) 
* is a distinguished member of & calied the 
edge state [ and 



g is a function g: S'S'S 

I 

the transition function. 

such that final a lata a are terminal 

[ij , 
(l ¥ e ¥ Va ZF t i ( [* ■ * | 

\ ' TTT ' J 



S called 



■ ) 



1*1 



and ehge states an conserved* 
(l,e, VjfSt g ( [ 



* 



9 



■ • 



a = s ) 



Two notational devices have beer, introduced in the above 
e>finition n Che Is the two - d3aen signal carta aim product . Ha the- r 
than txp:?es£ the domain of the transition function as the usual lina&r 
cartesian product of acta, we have taken the liberty of arranging the 
factors of the product In a two-dljunsianal manner which more clearly 
illustrates the process being aodslled* The second notatlanal device 



'£ 



int-re-lucsd 1* the don ' t cars symbol .. * w khicn is used to m place 



universally quantified variables. Thus "g^ 



3 ■ s B id 



noUt-.c-j-.al shorthand for » Vs, Vt, V #J V^ g( g 



5) } = s. u The set 



cvtt which quantification takea place is usually under steed, 

!>t H be & cell ty*:** An. array composed of sells of type J1 1* 
said to be an array of type M. If the array has a call a per column and 
n tills pair rc^, it is said to be- an n*n array of tyfta H, The notion 
of cell typp* formalizes the mochanisa underlying the operation of an 
array* Corresponding to the idea of an instantaneous description in the 
theory of Turing machines, we :oa Te the following definition. 

> finltl3n 

An ann description of type M { or simply a description 
if i, n* and H are understood) is an mm (natria with 
entries in S» where S 1* the ast, of cell states of 
the oell type H* An Initial description is a 
description, all of whose entries are initial states. 

Soto that a Ji*n description contains only enough i n f creation to 
detenini the states of the cells within an Hun array* The states of 
the remaining sella in the space are formally set equal toe by the 

following definition* 



1? 



Tafinition 



If D ia an m*n d&scrlption of t?.™ K than the 
state Of 0911 (i.J) III D, denoted D i - 1 Is the 
(t,jj-th entry in H provided 1 s i^m and 1 £ J.*; n* 
Uid Is otherwise, vhara « is tine edge state 
ftf H. 



rlotB that we have introd&ood natri* type coordinates* For 
example cell (l,l) is the northwest corner cell and call (u,n) is the 
ismithiPsstBt comer cell, 

'.1* transition function is now used to define the obvious nation 
of SUnceg-sDr* 

Ihf initio 

let D be in »xn desortptico of type H, The 
auocejssor °^ E is the n^n description of type tt f 
D" , given by 



% - *{ 





°. ■■/ 






% 


V" 




%i 





where £ is the transition function of H» 



Wb tan ncrtj fornaliie the concept of a computation. 



VS 



Definition 



An w computation of type M ia an Infinite 
sequence j^f^ D » D \ B f F „ of nen descriptions 



of type if such, that 



la an Initial daaeriptlon and 

Er is the suceesactr of IT fur all 1 >0 ¥ 
If £f- $, D , IT* ♦ ** is i Eomjiuta-iiDR^ T ,han 
D^ is said to be the atate of call (l p j} at 
time t In the computation j£f. 

This completes ch* formalitaticti of the terms necessary for 
Jsseri'Wjig an array and its functioning* We now formalize the terms 
necessary tc deaoribe reoog-nltlon problems* 

Definition 

__ 

An nun fA^r* over the sat T { or simply figure if 
it, n, and I are underst&od.) la an m*n matrix with 
entries In I* 

We will HOSt frequently consider floras ovsr th-e get I* 3 {b,w} 
representing black and white * When we wish to represent a specific 
fipirs over I * WO will Use a diagniB of the form ffiTT? rather than 
standard matrix notation. Note that a figure has a specific sis*. 
Ihua i— — and are distinct figures oven uiougn both 



are blank* 

a* cognition problems IjitdItio the separation of all fibres aver 
4 fixed aet Into two classes, the accepted figure a and tine rejected 

'9 



figurt a. we concentrate owr attention on one of the twe clashes. 

Dg-f ' -rtitlom 

A predicate, grir the set liai subset* ft* of tin 
ast of ill figlllWS orer I* The aimplBiBent of r'* 
denoted (^V is the- set of all figures OTar I which 
are not In V* 

It :.s the predicats which allows us to maJte ecnnectioaa between 
figures union h*7B similar properties * For instance we could fono a 
predieatf by taJting the s&t of all blank figures or the set of ill 
figures containing five or fswsr black squares* 

foully we relate eo«putatioris to recognition of predicates. For 
this purpose we will fix 9. sat F = ^a* r j which represents the final 
two state s of any 0*11 type Involved in a recognition problem* ltae 
S-..a-e! a and r correspaftd to a^ep-i ar.,d rejse', respect! vb^}\ 

Dafinition 

Let $ be & predicate over the set I and let K 
be a cell type* We aaj K aticejrtJ ^ (respectively 
rejects V3 if the following holdi 

i) I ia the aet of initial states of K ¥ 
ii) f =■ {a, r} is the set of final states 

of Mi 

iii) Given any caaputati.cn £f= W t D » IT* *.. 
of type H* we ha T e iPe f <^3> 3 t 
aueh that D* 1 1 = a (respectively D^^* = r), 
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tfe eny that ft recognltas f if 
1} ft accepts r t and 
H) M rejects f. 

Note that we actually require the set of initial states of H to 
be the riffle set as that over which 5^ Is defined- This not or.ly 
olijE j ca *es the need for introducing ar. artitrary eorraiiponccnea, but 
aotu*ll^.' make:; a figure and: an initial At i c ri pti oj; the sat* formal 
object, 

Va have =£d« an arbitrary choice of cell (1,1), the northwest 
com* if i^llp as being the cell which Is designated to give the accept 
or reject signal- Che could make a case fcr having the designated cell 
be scDie'ihene more centrally located In the array, but then ?ne v-j\LLd 
eithir Jiave to mtj™duce additional juachihftry so that that cell could 
be singled cut, or have the array compute the location of that cell 
each tijie it performed a computation, 

2.2 Ajt Example- f fflfi 

Fe™hapa it would ba bast at this point to give acme life to our 
definitions by considering an ejcample r 

Le~* %m ** tn * Predicate ever I 2 consisting of all figures with, 
an acid T:unt*r of black cells, ibis parity predicate play* an 
important role in the work of Kinsky and Fapert on the perceptrW 1G ) + 
They show that fp AR is very difficult for a perceptron to recognise 
and use this fact to show that nany Other predicates which are 
reducible in perceptron theory to ^ PAR are also difficult for a 
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™rse;jtron to recognisi * We will see that 'Phfl i£ quits Basil,)' 
r#eo£nl£*d by arrays* It la introduced hure only as an example and 
plays no role In oyr theory* 

We nov describe a sell type Kp^^whi^h recognizes "fp^ ( The 
tost precise way of describing "pas would be to list its states and 
display a state transition table- Unfartimataly a call type with ■ 
states has s^ rows in its complete state transition table. Since the 
cell tyi* we are a'aout to describe has & states, its transition table 
would have €r ■ 7,776 entries, making it quite unreadable as well a a 
shedding little light on the sethod by which m" p ^ R carries out its 
eonputatlon* Use of the, doa 1 t care symbol i #, drastically reduce s the 
number of entries needed, but a till leaves the underlying method of 
con potation to be puz-tled out be the reader. It has been feund that 
the best method or describing the functioning of a cell type ia to 
describe the action of a typical array couponed of eelia of that type 
on a typical figure. Attention is thus focused, on the method of 
a amputation rather than the machinery which carries it out* In mast 
cases wo do not even attempt to give a com pie to list of the states 
Involved ir. tho cell ty^e. The reader whc is interested in mora 
detailed analysis of pell type a may refer to nannie' 1 ; and 
Atrubin^. 

Operation of H™nl Assume the figure to be processed is at 
least 2*2. The- cases of 1*n and m*1 are easy modifier l.cn* cf tha 
main idea* Each cell which is not on the northern edge of trie array 
Siinply copies the State Of ita a anthem neighbor* In this way the 
infonaation within, each column of the array is shifted to the north* 



Wher. tie indorsation arrives at the northern edge, it is shifts d to Uia 
west by tha calls on th* northern edge. JLJ1 information eventually 
arriv** tt th* northw#st corner. Each Mil on tha northern edge of 
the array ccabines the information arriving; from the south with that 
flrriTiiK froni the west in sych. a way that parity is preserved* The 
northwest corner cell eventually arrives ir# state o or w depending on 
whether the parity waa odd or even respectively* All that renaina is 
to causa tha nnrthweet comer cell **o enter the appropriate final 
state* This Is accomplished by having a contagious rt done rt signal d 
'begin in the southeast corner at time t = 1 and spread at the rate of 
one cell par unit time toward the northwest comer eall b By the ti*e 
the nerthjfsat Comer detects the done signal, all of the parity 
information Will have been processed and the appropriate final state 
£■■1; hrj er. tared. 



ZJ 



rne foil wing dlagran illustrates the prc-sesa for a particular 
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Initial statos 



-p.pi a s described abcro has six states 
b black 
w white 

d ivr 
e edge 
a accept 
r rejext 
The reader who is ccncemed with the ruanber of states used in H 



} 



final states 
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nsay wish to show that Hpijj oernld be nidified to have only five states.* 
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2+3 TiMing 

Mote that K™ R jji general t#fres n +■ n - 1 tine units to 
Pteo^Liift in nun figure. Wa will be quite interested in thn amount of 
tia* required to reco^ilM ftrionj ppedicattSi bp «e nc« define seme 
Appropriate tanninC-logy, 

Dafinitlai 

Let HtH I call type with Initial states 1} P, p. 
figure over It and c£T= P, E » Ir, Jr t -.- th* 
cccj-utatlon of type H with F e» its initial 
description. If t is a real number, ve say that 
M reccgnises P wlthiil time t provided th?t D^ 
Is a fina4 state *f M, where [ ■ ia the greatest 
integer function. 

It woyld certainly have been adequate in the above definition to 
restrict t to the poaltiv* integers.. Howaver f the slight generality 
obtained by allowing t to range over the reals will be usefui later* 
^ha tiffling functions in the following definitions *re real valued for 
the same re As Dp,. 

flafinltian 

Let y be a predicate over I: M, a cell type which 
recognises r j and T{«in)i a real-valued function, 
Wa say that M recognises _£ within time T^n) 
provided that M recognlcea every nun figyra ever I 
within tine T(n T n) + 
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f» following definition forms a bagig for measuring the 
ccmplfljdty of predicates with respect to Iterance arrays. 

Esfinitlon 



Let T be a. predicate and T[K.n) .1 real -rallied 
Amotion, "rf's say that r is rpcoenisabl& withia 
tias T^Bi-P-) if there ejeists a CflU tyt» K such that 
" re c >vrnl z a = r fdthln time T(m.n), 

Thus w* would say that M pAR recognises ^par within tine 
c + .1 - 1 and that Pp^ is recognisable in tiae n + n-1. As we 
Shall Kf in Corollary £*U1 belQWV rp^ is not rBcaeninabla in ^ims 
pa + n - 2- This nesult is Hit appliqa~i<Hl cf the Interdepar^encB 
Theorea. To properly stats the- Interdependence Theores, vq nood 
three *ore definitions. 

Eefinition 



Let e 1 = ti^^] Mid a * ti^.jj) *» two pells* 

TJlfl- ctiatajice between 5,. and Uj ia given by the function 

j'cU' that the distance fuilctiMl j? la i metric on the set of all 
calls ami that the distance between two cells equals the anount °% 
tiMe it takes a signal to travel fron one va t-Lc other* 
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Definition 

If d is a po9ii.lv* integer, then the d- neighborfaood 
of a e*ll a is th« set 

N d (a) = ( c 1 | s' i* a cell and pU,c')^}. 

SiJicfl nelghborhoode: are defined over tie fcwo-vay infinite 
Cellular space of cell*, there fine nc edge affects and hence all 
d-nelEhbDrnoads have the same site and shape. Indeed the d-eeighborhood 
of a call C contains \ + 2-d-(d +1) cells and foms 1 diamond shaped 
: -luster of Delia a Lout c+ For example* 1-*£-» and ^-neiecborhoods 
have the following shapasi 
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Mot* that the atate transition function for any coll type i* a 
function which has as its dcoain a two^diMenslonal cartesian product of 
c§ll slates in the- shape of a 1 -neighborhood and which is used to 
predict th# state of the central cell of thit neighborhood at one time 
unit in tha future. The Tol lowing: definition and theorem gene rail re 
this concept. 

Let d be A positlTe ijyteger and tt a cell type with 
Bet of states 5. Then a d- nel^bcr-b cod iunctlsn Of 
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type X is a function whose do&airt is tit* two- 
di^ensional c-irtesian product o:' S with itself a 
total of 1 + -!-d'(d + ij tiafls (^arranged in the 
shape of a d-neighborhood) and whose range is 3. 

Theorem a.1 (Interdependence) 

Let W be a cbU type and d fc positive integer, then 
the;re exists a d^teighborhced function cf type M^ 
5*7 f» isucti that if £T= :f» D*, Ef 2 , .** is any 
computation of type Y., * is any non-negative integer, 
and c is any cell, then the state of c at time t + d 
can be obtained by applying f to the d-neighborhood 
of e at tJjse *;* 

HKXFt Tha result is inertia be f or d = 1 by letting f be the 
--nn^itlon function of cell type M. 

Assure by induction that it holds for all d< n and let d = el, 
Thsm for each o't N^c) we have N^tfl'JC Nd(o) by the triangle 
in^nality* Hence by induction the 5 tit* of Call &' at tin.* t + d - 1 
is a filiation of the state* at time t of all ceLIs in ^ d (c)p for all 
e'e Jil(i)+ 9ni by definition the transition function gives the state 
of ceil c at time t +■ d as a function of the states at time t + d - t 
of al c-'eN|(c), Composing these functions gives the desi.rad function 

*. 

The Interdependence Theorem is fundamental and bft-s several 
important applications* It Sin be netted In two different ways* As 
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stated, it allows one to nake predictions &haut the fitfjre otate of t. 
cell gi*en sufficient current infonqatian ibout the neighbor? of that 
coil* It will be used la this guise to prove the Speed-Up Theorem 
(Theorem 2.2 below) t Viewed In another way. the Interdependence 
Theorem states that two cells which are at a distance of d + 1 from 
each other cannot lnfluer.ee each other's behavior for the next d units 
of tajoe* In this fori It is 3l«ply the statstusnt that signals 
propagate at unit distance per unit time* bat sreidB mentioning 
signals: as such. In this latter form it may be used to establish 
zinia&l tixe results , such as the following. 

GoroUarj Z t 1 T l 

rp^p is not recognisable within time less than 

{a + n * 1 if either i * I or n = I 
a t a « 2 if 4,n^2. 

PROOF: Let H be a cell type which reeagniies ^Wr * 

First consider the case where a = 1. Let IT bo an Initial 
description, say 



rf " M^'H i --IH 



Now create the Initial description £^ by adding a black square to the 
eastern end of IT. Thus 



M^MJ '" }\*^} b 



If cm the cells in the Cn-1) -neighborhood of cell (1,1) have the sane 
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states ir, both sr and Br. Hence by the Intierdependenee Theorem, call 
(1*1 J will be In the same state in both if" 1 and E 11 ' 1 * But sinco H 
recognise a Tjj^ and since XT and £ have opposite paj-ity, this state 
cannot be a final state. Urns K takes at least n + a. * 1 = a units of 
tiae to recognize ^^ when a - 1* 

The case whore n = 1 is similar. 

Finally assume that m,n^2 + Consider a typical initial description, 



^-® 



fe 




Not* that the southeast corner cell (nun) is at a distance m ■+- n - 2 
frcm cell (1,1) and hence by the Interdependence Tneoreii Cell (1i1) is 
independent of the state of cell (p.n) for the first n + ■ - 3 units Df 
tine* Hence since ^p, depends on the state of cell {m,n), we have 
that Y requires at least m + n - 2 units to reco^nita f^p, . Q 

frote that the cfjly- property of rp^ which we used In the above 
proof was that it depended an the initial state of cell (m»n). Thus 
we have actually proved the following ■ 

farallarj 2>1 »2 

Bo reasonable predicate! r, can be recognised in 
Ujm lest than ^jm™ where by reas enable we mean 
that for any ja,n ^1 there exist two figures P and P h 
which, differ only in their (n*n) entry and such that 
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Pe t and PW ¥ 
TSic reade™ with an tya for derail will not* that, the flail type 
■^FWR Mha * meted earlier actually achie^e-a Tite theoretical Blrtlmuii 
timing only for the eases n = 1 or a = 1 ami it is ana Ltp.lt slower 
than the ainianus For the cases where n,n£2. This minor dafoet tan be 
ranedied by modifying M PAR , The smallaat number of a tat** the author 
haa found; for auah a modified fla china is BBVan. Details: are la ft to 
thu fa^de.", 

2.1* Speed-Ifp- 

Wa now turn to tha S£«.»d-Up Theerem H The central idea behind thi* 
Ui&oraH is that by packing information Into fa war calls In an array, 
the information can be processed at a higher rata Since tae amount 
of tins It takes for a signal to travel from the location of one 
place of Infonnaiisn to the location of another ha* boon reduced. This 
Idea haa occurred to many people and usea of It nay b# found in the 
paper* of Cole k \ Fischer^, and; Heimie^ 6 ^ In their f omul* tions no 
information is initially present In the computer and henca tha packing 
C«l be dons aa tha information ia input to th* computer* In this way 
they achieve any da aired degree cf speed-up without having to pa/ a 
price in procesaing time, although the/ dc increase the number of states 
per cell* In our formulation t the information to be processed is 
initially present In the array ar.d soma time must be epent in packing 
it into a mailer am* within tha array. Thus we auat pay a price in 
both tine and states to achieve a speed-up. 
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C nft - [jii«nsipnal Case: As a wanning up eaertis* for the tvo~ 
dilieaii iorif.l Speed-'lp The >tf6m r we first ccniider a one -dknen signal 
siiattp].*. Assume that we have sat up acme figure in a H^9 array of 
colls of type M and 1st \s observe its operation for a feu tiwe unit*. 
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7tie n + vitbol Sj of course represents the state of cell (l.j) at 
tiae t. We are going to describe a cell type H,. wiie^a each cell nwst 
halra 1J1B -CLbdlity to simulate two calls of tjrpe M» &ir notation should 
be tavjispajient. Sanely 
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reprefien^s one cell of type Mj which ii currently in * state papi^s seat- 
ing tvo cells of type M* one of which is in state Sg and the other of 
which is 'ji state S^. Extensions of this notation will be introduced 
without further cement* Since we will be talking about, both K cello 
and M r> coJ.ls at the same "lias* we will find it convenient to refer to 
the fuime" as cells and the latter as module . For example, we say 
that each module in an M array simulates two cells. Now let us 
obsesr.-e the operation of a 1*9 array of type H, when started with the 
same figure^ Thai first five steps of this ep* ration are shown in the 
di&grc-tt on the next page. 
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J.t this point* the i^ array ha? packed the original rigure by a 
factor of two and is ready to begin processing the figure at a rate 
exactly two tine? that of tha H array. Note that the packing prooesa 
takes n - J time units in general, mhere n la the length af the array, 
k is tha packing factor, and [-J la the greatest integer function*. 
(\h ccnaidnr tha pecking to be cospl&tfr when tha sttga state e can ho 
longer move to the left*) 

Che problem new arises* We would like all of '.he modules in the 
packed portion cf the array to begi* their simulation simultaneously* 
Tnia ia accomplished by using a firing squat* procedure auch as that 
described in Bal£Bi-^\ The laat module to be packed (module £1*5) in 
our exajtapl*) acta a a the general cf a firing squad with the soldiers 
being the modules to the left of the general, Tha raodulas in tha 
firing pquad retain their packed information on on* level whi^e 
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aarfyixig cut the firing Vjllld process on another level. Whan the 
firing &\ua.d, goes Off, tll3 simulation begins,, Note ^hat the fifing 
3a.\iad fj*scea», if carried 1 out as described above f will take ^' r units 
to begin simulation. ThUtf the ;=i™uInition gets under way at ti»a 
% - n -f ' 5 L The reader who is f end of firing squad problems may show 
hok- this tlB* can be- reduced to t = n by be ginning a em* firing squad 
Activity at tiate t ■ instead of waiting for the packing to be 
copiplotetL Note that t - n is the earliest the simulation can begin, 
5ir.ee by the Interdependence Theorem module (l P cannot begin simulatlan 
oaf ore it is aware of the existence of the right-hand end of the array 
and this cannot happen before t = n* We will omit the details of the 
firing s^uf^ mechanism, since an alternate method for synchronisation 
will be giVnn later. 

Lot us assume then that at time t = 9 o*ir arra/ begins simulation* 
The process will Look as fcllowa. 
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Dotted arrows, have been drawn to show how module 11,2)* which is 
responsible for simalat iiig cell (1»3)» has access to all of the 
Information necessary for predicting the state of cell (1,3) two 
units into the future via the Interdependence Theorem.. In general 
with a packing factor of fc, one obtains a simulation which is faster 
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by a factor of k. 

The simulation continues until module (1,1) senses that cell (1 t |) 

is about to enter a final state* Instead o^ simulating trits entry, 

module (l.l) actually entiirs that final scats itself. Thus the K 

2 
array accepts or rejects the initial figure according as the K array 

wild have accepted or rejected it* 

Si'^ce simulation begins at step m, recognition takes place at tine 
t = n + T^"J •* 1 |^ wnara T( n#n ) i s ^he time in wnich M carries out 
its recognition, The number of states required is approximately a- a 
vhure ; is the r.xmber of states of c^il type H and whtrs vb assure one 
posses;jes an sight state solution to the firing souad problem. 

Progressiva Synch ron t Eflt 1 On. ; 3afore tunning to the two-dlmenaicniw 
case, we present a second solution to the s^nstircniiation problem 
which does nat use the firing squad. This *>ftco [: ,d .s^ilutior. is slightly 
faster than the firing squad method., but USOS approjdaately 2 s^ 
States per dell* We present it here because it is of interest in its 
own riflhl. Let us call it the method cf progressive synchronisation * 

In progressive synch rcniiatiort the simulation begins to- ta*e 
place- while ths packing operation is etui under way. Each nodule 
Carries out A aiHUlation step as soon as the. necessary information 
be cones available to it. Modules which begin to simulate before 
packing is complete carry cut their Simula ;icn at a reduced rate 
because Of limited information availability, In* last module to 
ho packed imaediately begins simulation at full speed; arm eventually 
catena? up "rfith the modules which began simulation earlier. Larger 
and larger block a of moduLeE beccse synchronised Until at last the 
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The diagraa an the preneiinG page illustrates progressive 
synchronization as it would oe used in our example. From t = 9 
on simulation proceeds as in the firing squad case* 

Sach aoduia in the abo7e diagram must actually have on* rt.ore 
bit Of information SO that It Can Indicate to lta neighbors when it 
bas made a simulated state translilya, Wo have omlt-ed this bit from 
the diagrams above. 

Observe how modulo (1*2) carries out a simulation step each time 
the necessary information becoaes available in the: neighboring modules* 
Also sbscrve hov tha last -ocxus to be packed, module {1*53* is able 
to begin simulation at lull speed as soon as it is packed* Since this 
■odule is packed at time t = n - jjk the recognition will take place 
nt time t - n - Hi] + pi a x n j. - r. t- i or before. The case where 
recojpiiticn takes place sooner is due to the fact that module (1,0 is 
several simulation steps ahead for a while* 

To recapitulate, we can create, using firing squad technique s p a 

ceil type which performs recognition in time t = n + i ■A ' i [ >: ~ ' and 

t, 

Mhieh has on the order of 9* states* By using the method of 

progressive synchronisation + va can create a cell type which performs 

recognition in fuue t = n + 1 - ft + Tu »n) - 1 ajLf j ^^ an ^ a ort $ aT 

ak. l J u J 

Of a £K states. 

The mathcd of progressive synchronisation introduced above belongs 

to a Class of iterative programing techniques which ve shall call 

methods of npn- uniform simulation . These methods all have the 

following characteristics in common : 
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1) they involve simulation of 6ns array by another, 

2) a module Lq tht> simulator may heap multiple copies of 
the cells that it is simulating, and 

3) simulated time say be distorted, that Is, at any 
given raOmnnt modules which are spatially separated; in 
'.ho .simulating array may be working at different 
points iii s initiated tijne. 

We will use a method, of nan-uniform, simulation in the proof of 
Theorem 2„5» 

S2oftd-tf£: We now turn to the two-diiiensionai Speed- Up Theorem, 
lhe statement of the theorea could be sharpened in several ways. 
Preferring ijib more simple and workable statement for cur main re suit *. 
wb will leave the aharpar.ing to a corollary* 

The area 2*2 (Speed-Up) 

Let P be a predicate- and let tt be a cell type 
which recognises ¥ in time T(m,n)* Ifcen Riven 
any positive integer k T there exists a oell type 
H which reucgniEea ^ in time £-T(m,n) + H +■ n + 2* 

K It. 

PROOF: The two-dimensional case Is quite similar to the one-dimensional 
nise» Vs perform, packing by a fac^c-r o£ H followed hy or overlapped 
with simulation at a rate k times faster than the original array, 
Again vb havs our choice of Using a two-dimensional firing squad or of 
uair.g a aethod of progressive synchronisation » 

Packing ] Tacking Is accomplished by performing simultaneous 
packing within each row and when all the cells in a given coluan ara 

3a 



fully F A °l (t8 d 1 tn» column Is then packed. T*ib following diagram 
illustrate* packing by a factor of two, where each sijimlated cell 
is ^presented by a single dot* 
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Packing ia completed inn-B+n-r wilts of time. Assuming 
that prcgnessive syn&hronla.ition ia upedi- simulation gets under way 
Ijnraediately . 

Simulation ; In considering tvc-dimwisionil simulation* we find a 
problem which wasn't present in the one- dimensional case. It is due 
to th# fact that we do not allow diagonal neighbor connections in our 
modal, 

Conaldjei* a portion of an H, array attempting to simulate an 
M-array at a rate three timee faster than, normal. 
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This central module in the abore diagram has responsibility far 
sjjflulatir.g the ceils labeled 1* In order to advance the state* of 
these cells by three units, the central module must tiavo access to the 
cells labelori ?. and J» Because diagaqal connections are prohibit*^ 
access is available only to those cells labeled 2» 

"Hie re are several ways around this problem,, Ctn.0- is to a "low 
diagonal c abjections betwsen cells. In that case, assuming' diagonal 
connection a were also allowed in the K -array. Lhs central module in 
the diagram above would require access to all simulated eella shown. 
Thus it would actaalljr have a see 3 3 to exactly the information needed 
to advance the states of the cells for which it is re sponsible* 

Within ths restriction of nearest neighbor interact! an , we could 
simply pack by a factor of six and then use two Stepa of real time to 
allow Bach Module to get information around the comer fr™ its diagonal 
neighbor and advance the states of the oella for which it is 
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responsible by si* a tops, Tbua an average 9peed-up of three would 
neBult + The cost In teniis of states, howeVei- T wsuld be high. In 
order far each nodal* to pa as inronDation around the comer during the 
inte mediate step* It would have to b-.ave p.-D visions in its memory for 
r*mt>nbering additional sunmlatad cells. Th& smallest number of 
additional stimulated Cells require tt seer,g to be £-k - k - 1. Thus In 
the case above where k = 6, we wou'.i require each module in the 
simulator %a have memory capacity for holding eighty- three simulated 
cell Si just to provide an average speed-up faster :":f three. When 
ciimriarftd with the nine simulated cells required per module in ':;£ 
diagonal connect ion case, the cost of this method sftftfflS excessive, 

A nOra reasonable aethod is now described which requires tventy- 
five simulated cells per nodule to produce a speed-up of UireE, It is 
apparent that a module, if it is to advance toe sells fur which tt is 
responsible, needs access to information ab~ut the states cf the cells 
for which its d±a£cnaj. neighbor is responsible. Instead of having this 
information ccoputed by the diagonal neighbor and then passed around 
the comer via a nearest neighbor, ve let the nearest neighbor 
compute the information, directly, thus making it available on& tiav 
unit sooner, 

Consider the diagram on the following page which represents one 
module in the s inula tor array. 
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The module contains twenty-five simulated Cells. Tne centra.! 
ni_na t which ai-e drawn with solid 1 lines, an th* same ftS those fo* 
which It would bs responsible under the earlier scheme* We 34/ that 
theae are' the dells for which It is primarily responsible* One think? 
of these primary cells as being- the Cues wMch are "really" being 
simulated and that the a'jcteen seccndary cells are Simulated merely as 
a convenience for the benefit of the module's nearest nei^hhosrs,. 

The- following diagram ghcwa a portion af an array which is to be 
simulated. 
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Three concentric heavy outline 9 have been dr-awti. The innermost out- 
line contains a set of nine cells for which a aic-*ile ia primarily 
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responsible. The widdla outline contains the twenty-five cells for 
which this module is both primarily and secondarily responsible. The 
cuter outline shows the set of cells to which the module has access 
Via its nearest neighbors at any given stej» Note diat the cells 
contained in the outer outline are exactly those cells to which access 
is required for a speed-up of three. 

The following diagraja, presents the situation from the point of 
view of the simulating array. 
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The preceding dieKran shows a 3*3 set of nodules and within each the 
aim^l^tod cells for which It is responsible* Each slMulatad Call has 
been labeled with its i-CM and column nilfllber* So«e nails such as {fl,51 
are simulated by as iiany Is five different modules* All *ne simulated, 
by at least three modules, 

Qf the nan/ petfoods of simulation considered by the author* the 
above method requires the fewest states fer the ease of flea rest 
neighbor interaction* "t requires 2-(k + k) states (for k even) 
and 2{k £ + k> + 1 states (far k odd), 

Conclusion ? "rfe have all tne pieces necessary to construct a call 
type X. i given M and h. Tn recapitulate > M first performs packing by 
a factor of k and then begins nigh speed simulation* Simula C-Sn is 
begun either by the method of progressive synchronization or by the use 
of the two-dimensicnal firing squad which is discussed in Section 4»3* 

The method of progressive synchronisation requires oil the order of 
s*(k + k) states per cell and recognition is completed on or before 
tias t - in + n - j"g ' - fgl +■ pfoi 1 ^ ~ H + Z ^ 1-T[h.il> + m + n + 2. 

Tne firing sq^ad method requires on the Order of S?{lf + k) 
state a per cell and recognition is completed on or before tine 



t = z(m + n) - 



r. 
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- [g + nax {*.n J + P^i 1 ^" I T, The details of 
the latter formula follow from a knowledge of the two-dimensional 
firing s:pad which is. discussed in Section ^*3* 

Ibis completes our proof of the Speed-Up Theorem. U 

We now state as a corollary to the above proof the -complete 
Statement of the Spaeri-"Jp Theorem* 



Corollary 2*2*} 

There exists a. known effective procedure which, when 
given a positive in tegs r k and a cell type K, 
produce* a Ml. type M^ such that 

ij « milt have the fane Initial and 

final ptates 
11) any v\*Ti figure P which is recognized by 
K in tijne t if recognised by P in tine 

In the proof of the Speed-Up The cram, we pen U eued the i,riea of 
havitig packing going en ±n one layer of th* array and a filing squad 
going on in another layoj- of the array. This conceptual trick of 
resolving the processing of an array inta several seal-independent 
but eiaultaneouLLi processes and of picturing them as taking place in 
different layers of the array in simple tint powerful* As an application, 
we present 

ThEorea g.3 {Minimi ting) 

Let ^ be a predicate and let H t and K, be cell 
types which recognise f in tines T^n.n) and 
T (n P ii) respectively* Then there Bjdsts a cell 
type V. which ncogni3.es f in tlai* 
Tta.n} - Bin [T^a.n)* T (h,ii)} * 

PSCQFt Let H consist of two layers* Che layer behaves likf H., the 
other like M^. Cell ( 1 * 1 ) goes to its final state as soon as either 
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layer completes its recognition* Since both layers recognize the S*ihe 

predicate, there can be no conflict. U 

?.,$ Computing Power 

We not turn to tn* study of the class of predicates uSii,ch con be 
rfiCognizflri by arrays, 

Lb fin 111 Or. 

A predicate ¥ is said to be a Cellular predicate 
if there exists a cell type M which rscogniE.es f . 

it contains onL/ a finite number of figures. 

Theorse. 2«4 {Bo dean /Finite} 

The class of cellular predicates forms a Boolean 

algebra and contains all finite predicates* 

Furtaennare* given two cellular predicates rj 

a^d Ifj which are recognizable in tune T Am, a) 

and T ? [«,n) respectively then both rj U f£ an4 

^ H r^ are reuDRiiiEflble in time max {T 1 (a h n)*Tj(in. l nJf * 

PRCCft PrDDf cf the closure &f tne class of cellular predicates under 
the Bodean cparatians cf union + intersection h and complementation is 
directly analogous 'o the proof of this property for regular events. 
Layers a^e used as the method of combining two distinct cell types. 
To prove the second statement, let r be any finite predicate 
and let k b« the S&allest integer such that all figures in ¥ are 
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kiik or snail*!-, Conetruct a call type which pucks by a factor of k + 1 
As jKn as ceil (1,1) is packed it will hate all of the inferaAtlon 
necessary to accapt or reject the figure alnce any figure larger than 
k*k jnuat be rejected and since there are only a finite number of 
fibres k*k or smaller. The entire process will be completed by at 
"j6E.?t vine t = 2k - 1. 

In recursion theory one fimis that there are sets which are 
recursively annmarabLi but not recursive, jfcat is thane are jets 
which can be accepted (or rejected) by Turing machlnae, but which 
cannot be recognized ay Turing nachlr.es. The following theoran shows 
there ia no analogous situation for arrays. 

a^orei &,j 

L*t ^ be a predicate and let M be * cell type which 
accepts (or rejects) t . Then f Is a cellular 
predicate and a call type M" which reco^niEea ^ 
can be effectively constructed fram H. 

PROOF] let ue assume that H accepts V% the case where w reject* V' 
being similar, He will give two different ways in which the call 
type K 1 may be construe t*d* 

(Method 1). Let an M" array consist of two layers The bottom 
layer acta a a H doe a and nay eventually accept or reject Y* in which 
case H 1 does alec. The top layer acts as a counter with a capacity 
of (s » t) , where a is the number of states of cell type H» (We 
us* s - 1 rather than s since the edge state * does not matter for 
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the pressnt purposes,) When the counter reaches the value (a - 1 )"*"',. 
a signal is sent to the cell (U) which rejects the figure If it has 
not already been recognised* The basts for this se-TLhod is that the 
entire haxa array of type M, which ia being simulated In the botto* layer. 
has only £s - 1)™ 11 state s and hence must ba In a loop if it has not 
recognized the figure by tine t = (e - ^} mR . It is assumed that the 
leader- has no difficulty In seeing how to orgainiEa the top layer of 
M" into a counter of capacity (s - 1)™. 

(Method 2a )♦ In this method we will detect possible looping of 
the M array by having two layers in T -he M." array each of which behaves 
as an M array* One layer rung at half the speed of the other. The 
twc layers will be In Identical states at tine t = Q, but the slower 
layer will immediately fall behind. When the two layers again achieve 
identical states, ub knew that they must bs in loops, Since the faster 
layer must be entering this state for at least the second tims , Wh&n 
such, a looping condition is detected, the figure nay be rejected if it 
has net already been recognized. 

Th% probls* her* is how to detect whan the two layers are in the 
saiT.e state. One straight forward but ti*e eonsuninp method would be to 
have a third iayer which observes Ahd controls the first two* The 
third layer would cause tie ether two to advance by one and two steps 
respectively and. would then inhibit their action* Each cell of the 
inird i&yur v-^ld then compare the states of the corresponding cells 
in the ofcner twc layers and would genera -_e a signal ihdlcatuLg 
whether or not they were in the same state, These signals would be 
accumulated at one point, say cell (1*1)* in much the sass manner as the 
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parity Information was accumulated by Hp An » Coll (t*1) would than 
decide whether the figure should be rejected or whether 3m other step 
tn i.tw simulation should be carried out* If the latter is the ease, 
a firing acuad ceuLi to started to initiate another a tap In the 
gimulatien* This method clearly turns up v. lot of time* since the 
aoT.umilation portion takss about a ■+ n steps and tJia firing aquad take* 
another ■ + n + max {m.nj steps* A much faster method, is now 
d*t*erib#d» It will be aore expensive In terms of atataa Tiaqui:»d* 

(method Sb). Wa will use a method of non-unifom simulation* The 
bnsic idea is that wa-ras of simulation spread out frcn tha southeast 
coj-iar. ahead of each wava the two layers are at simulated times 
t^ nnd t . After a wave passes,, they are at Simula tad timea t 1 + 1 
and t 2 + 2* Between the wa^es of simulation cobb conpariaon waves 
which accmraulate the necessary comparison information* As each 
comparison wave washes oner cell {1.1} t ail the information necessary 
to decide whether or not a loop as been anteiad is present and oell 
(1J) can hake its dacigian* The speed of the method comas fron the 
fact that one wave may follow iraaedlateljf behind another, 

%a way of studying the class of cellular predicatas is to 
conper* it to the classes of predicate a r*c editable by other types 
of recognition device a such aa -„be perception, Wa hava already seen 
one cellular predicate, namely V WR , which is not in the class of 
predicates ra-E-ogni^afrle by order or diameter Halted percept rang* 
tfther predicates which have been considered by Hinaky and Fapert.^ 10 ) 
in connection, with the pereaptran will be discussed in Chapter y m 
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Kennio ^ e ' has classified arrays by the number of directions In 
which signals nay Flow within the array ant than compared the relative 
c^m^uting power of varie.is classes. 

Other types of recognition devices may be obtained by aoiiifying 
nt-mal one-difliensienal tape -accepting devices to operate on two- 
diminsional tapes* C en aider fcr a moment a universal computer which is 
able to walk about on a ^wa-dimansional tape, sense the edges without 
rtepping off the tape, atid which car. read the symbols written on the 
^r-w* [A two counter machine provides a more tidy mental image of thia 
\y-otsas than a luring machine! since the latter mist drag its tape 
behind: and ia always in dange™ of tripping over it J We will use 
the phrase fwo-diinansianal universal comouter to describe such a device, 
■riven a figure japrasented on a tape* the machine- can wan tier about on 
the figure and eventually accept or reject the figure. Tne phrases 
two ~ dimsn5l.cnai f la it ft state automaton , two - dlaan 5 1 onal PUSh - down 
a u.t rjHAt, on . and wWQ - dim.ensioiT' L . . ir; a ar bounda d au t oma ton describe 
alalia r adaptations of one-d5j»ns,ional da vice a- 

Blua and Hewitt introduced a special class of two-dimensional 
da vice a called pebble automata . These devices are just two-dimensional 
finite state auicaata, which are provided with a fixed finite number 
■of markers (ealltd pebbles) which thay carry about with then and leave 
f.'U squares as te^porarv if;* risers. Upon returning to a square on which 
r. marker had bean previously placed, the automaton can sense its 
presence* pick it up, and carry it off for further use if so desired. 
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Given two class* s C, and C ? of d#\lees for recegnlling 
predicates, we say that C, is strictly more, powerful 
than Cj provided that the- class of predicates 
recognised by devices In C. 1? a proper subclass of 
the class of predicates recognised by devices Iji C.. 
If these classes are the SarA. u« Say that C, is 
equivalent in power to C^ IJote that Lh« relation 
thus defined induces a partial ordering Col the 
family of c3aasR5 of computing devices. 

Theorem 2.6 {Non-Universality) 

TVo-difflansionaL universal -ncmputers im strictly 
Jiore powerful than iterative arrays. 

PROOF; Certainly a universal computer Can rtCogniS* anything Which 
can 09 recognised by an iterative array* Ihe existence of a predicate 
i»,i 1 •::!'. i.s rftcopi:zib",fi by 4 u^ivers-il c emptier, but v.v.i?!-. is r.ot a 
eelJular predicate can be obtained by- a dlaganaliTation argument as 
follows. Set up some fixed effective raetiiad fo? coding descriptions of 
cell types into figures* Then eon aider t^e predicate t^g (iven as 
follows I 

!P is a coded description of a cell 
type H such that an array of type M 
would reject ?♦ 
Now ^pj^g is certainly .in effectively computable predicate. Assume it 
is a cellular predicate and let N 1 be a cell type which recognises- it* 



Lot P 1 Oft the COaWd. do s crlpti on ofB 1 . Then P* « ^(HAG ^^-^ K ' 
rejects P 1 by definittor, of ^ DtAG . But K f rejects P f ^=^ p 1 ^ %^ fi 
a_ri'5Bi K 1 is as-suned to recognise ^DlAG + ^ s contradiction shows 
t}i*-t T()j4g Is not cellular. U 

Before stating the text two theorems, let us describe the nodal 
-*f two-dimensional linear bounded automata which we will use* Ma 
could asaujqe that such a device has a one-dimensional auxiliary 
working tape which ia hounded Ifl length by a linear function of the 

ynber of equa re 9 in the input figure. We villi how»v»r ( take tint rasre 
ntural approach that the device has no auxiliary tape, bit rather- 
Uses the input figure itself as a 'tape and is able ta both read and 
write Od the figure with a finite get cf symbols Of which the initial 
figure *s syabols My be inly a subset , Xhlg model seems much more 
natural in the current iOntext, We also assuas that tha automaton la 
always started in ita Initial state on square [1,1). 

Theorem 2.2. 

Two-dinensional linear hounded automata are strictly 
more powerful than pebble automata* 

PSQOF: Using the model nf a linear bounded automaton [IBaJ described 
a'Liove, it is easy ic- sea haw h given any pebble automaton (FA) N we 
ran construct an, LEA to simulate it {in fact to slnuiate it in real 
time)*. 

To show that LEA's are- strictly acre powerful than PA r s, we carry 
out the same diagonal isati on. argument found in the proof of Theorea Z*£> t 



replacing Universal computer by LHA and Iterative array by FA* The* 1 * 
are sow things to check. First cno must 'sheck that a coding of PA's 
fin be produced such that a sLngle LBA can l^ok *v .1 coded dBscniuiiin 
of any PA anil then simulate that PA operating on its awn description F 
Second sine* a PA nay begin looping rather than accepting or rejecting 
a figure, ho must ensure that the LBA qhi detect such loops. This can 
be don* by an adaptation of the second method of detecting loops In the 
p-roof of Theoren 2*5* Nanely two copies of the PA are simulated, on* 
copy at ons rata and the Other, at half the rate* In between simulated 
,ta-ps the LBA cheeks to sfte If the two simulated. PA's are In the same 
location and sane state end if they have thair pebbles all arranged in 
the fame Banner. This nust eventually happan tf the PA' a enter a loop 
and hence the LEA can determine if tne PA described has rejected its 
own description by looping* U 

IbeOrea 2j6 

Iterative arrays are equivalent in power to two- 
dimensional linear bounded automata * Indeed, given 
any predicate ^ which is recognisable in time 
T(n»n) by a linear bounded automaton and given any 
positive integer k, t is recognisable by an array 
in time l.TOfc^n) + (1 + Iks + n) + 2. 
Convsrsely* given any predicate r which is 
recognisable in ti*M T(b*zi> by an array and given 
any positive integer k, r Is recognisable in tin* 



jL U*>n)j +1), 

53 



?P.10F: It is clsar that an array can a±jwl*te « linear fcounded 
T,u*-.omatcn(l.Eft) In rfl*l tine* However, the .'„BA can make its decision 
about the figure from! any position Qfl the figure whereas the array 
Tiuat deiiver Its anawer to coll (1,1 J* Thus if the L3A takes 
tine T(n+n) to recognise the figyre* then in array might take as long 
as TfiB.n) + a + n - 2 + Given any positive integer k t wo have by the 
Speed-Up Theorem that ^ can be recogniud by an array In tin 
J-(T(h»h) + B*-ii-2)+ii-fa + 2< l.T(n,n) + (1 + l>{m + i»> ^2. 

It if also not -difficult to see how an LEA might simulate an 
array* It could use a working alphabet which would allow it to 
represent two different call states within one square of the figure* 
One of these states would represent the state of the cell at the 
"currant time 11 and the other the State of the cell at the "ns-JTt t^JPB.* 
By making a pass over the array It would be able to update the states 
of each cell. The fi.-st method of paiiing ovor the array which, one 
■considers usually involves tracing out a path a 9 indicated in the 
following diagraa, which shows the LdA making a scan, of one row* 




This is the path traced out by an LEft Which examines each of 
the neighbors of a cell in turn so that it can update the state of th B 
oell, The black dots in the diagram, ahore represent tie points at 



which the LBA has accumulated enough inromation to update, a cell. 
Note that the LEA makes :.:*vsn moveMsnts per cell. 

If inataad of attempting te update ttio stats of each coll on 
each pass 6T*r the array, we allow several preparatory passes ■ we can 
reduce the average number of mOTements per cell to four,. In this eass 
ths I3H keeps four simulated, cells within each square of -the tape. CSno 
represents the cell locate d at that position and the other three 
represent its was tain, northern p and eastern neifincors. 




The LBA begins in the northwest corner and describes the fell owing- 
path. 
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Hiring this pass each square can be narked to rspresant the states of 
its western and eastern neighbors. 

Tab LEA nexi describes ^he following path. 




During this pass each square is marised with the state of it a northern 
neighbor upon the first Visit f.-cm the L3A and upon the second visit 
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the *3A* wliieh is cowing tip frot the a-outh, hag ill the Inf-cjiEailon 
nacasaaiy to advance the state of the cell fcy one time unit* 

An observer s-tatisned at a £iven cell in the interior of the 
array would no£e the following build up of infonali™ vhan a dot 
represents information afciout the current state of a cell. 




Be fare first visit by ths LBA, 




After first, visit. 
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i 





After second visit. 






After third visit. 



[fi] 



After fourth visit. 

(The state of the cell has now been 
advanced by one simulated time unit.) 



lne entire process involves an average of four DiDvetnents. par- e*ll 
per unit simulated tijne. But given ahy positive integer k, we can 
simulate not Just one time unit per pass H but k time units per pass 
simply by increasing the information deposited in eech square by the 
LBA on its first three visits to the square. Of course the L9A aust 
carry along more local information in this case* Tor example, If k ■ J t 
then the information capacity of each square would! be sixteen cells 
and our observer would note the following sequence of events* 
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Bofara first visit by the LBA. 



After first visit. 



After second visit. 



After third visit, 
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Aftei- fojFtfa visit. 

t'ltis vta's is now edvancrm by 
three simulated time units*) 

The tdaijig nasult stated in the theorem now follows ijumediateiy. Q 

Corollary %*&. 1 

Iterative arrays ana strictly more powerful than 
pebble automata* 

PROOF: Imadiate frcm TheoranB £*? and 2*8, 

Let ua return for a monetit to the idea of a two-dimensional 
universal computsr. 



A predicate ^ Is said to be effectively naeogiizabjg 
if th»ra (jxtatfi a two^-dimfln sional universal CCmputej- 
Which ^cognizes T* We say we are given ar. 
effectively recognisable predicate ^ provided ws am 
given a finite description of «. univerial computer 
which recognizes r r 

We nw state sohb undBcidaciltiy results:* Mote that Theore&i 2.6 
proved the existence of a non-celiular affectively in cognizable 
predicate. 
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wn^n—m *■ 

Given an effectively recognizable predicate ¥, it 
is in general ui olecidabla whether or not f isi 
cellular predicate.. 

PKCOF; tey theorem 2*6 there exist effectively recognitabl* predicate* 
whtch are no^ cellular. Lot ¥ be sach a. predicate. K™ given any 
Turing machine T t lot Vj be given by 

!F€ F and P Is an n*n pattern and T 
doesn't halt in B*n step? whan started 
on a blank tape. 
Wow t r is certainly effectively reeegnliable* Furthermore ^ i* 
finite ^^ T eventually halt* on a blank tape, by definition of 
Y T ■ Sit ^ T '^ ^^ T doeen't halt on a blank tape, again by 
definition of Vj* Since finite predicates are cellular by Theorem z*> 
and sinca $' is not cellular, we have that W T is cellular <=> t 
halts on a blank tape, ^h* theorem fellows by the undecldahility of 
the halting problem for Turing machines* U 

Theorem 2.10 

Given a cellular predicate r and a cell type M t 
it is in general undecldable whether or not M 
recognize 9 Ym 

PROOFt Let T be a Turing machine and M' be a oell type which 
re cognize a V. Const rtiot a cell type M-, which first simulate a T 
stirting vn a blani tape for m steps or until T makes an excursion of 



fiy 



moi-e than n units, frc* l.ts starting point. {Ji similar construction 
ha.i.9d On tha peat correspondence pj*cbiam rather than Mi Turing machines 
may be found in Chap tar 3 or Henr.ie^ \) 1£ T ha* net halted hy the 
tine the simulation ends, M™ then simul&t*B H 1 and KJCOpts Or rejects 
¥ according is «■ dees. If T has halted, then M.j ginuLaUa M' and 
makes the apposite classification £rtm tha one M r would have made. 
Tnus K^ recognizes ^ £l^ T never halts. The theore* follows* ["" 

.pafinltlon 

Two call "types are said to be equivalent if they 
recognite the sane predicate * 

The following corollaries due to Heiinifi ^ are immediate from the 
above theotBjna, Hennle shows the ccrcllaiiea hold even if one assumes 
that signals can only travel from east to wast and from south to north 
within the array. 

Corollary £.10*1 (Hennle) 

Equivalence of cell types is undecidable, 

Carol la ry 2.1S*£ (hennie) 

Given a cell type K, it is unde citable whether or 
not it accepts any floras* 

2.6 Linear Predicates 

We now define an important CUSS Sf predicates. 
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Definition 

A. predicate ^' ifl said to t* llrear if there exist 
non-negative stager* p» q, and r audi that r i* 
recognisable within timi* im + qn + r* 

In view of C Miliary 2,t,Z p W • night be justified in aayir.g that 
the following "Lhearam sbowa "Jaat linear predicates can be recognized 
* almost* as fast as any predicate. 

Theorem Z T _1J_ 

If Pis 8 linear pjiedicate, 'then for any rani £>D» 
Sf ig recognisable within td^e (1 + £ ){jd + n) +2. 

FfiOOFt Let p, q» and r bo auch. that ¥^ la recognisable within tine 
jm. +qn + r. Lot b = ma* -jp + r, q + r j * Then since m h n ^t„ we have 
pa + qn + r *, (p + r)m ■+ (q t r)n 4 a (* * r )» Hence !r ia 
recognizable within tine a (m ■+ n) ¥ Let k be a positive integer stfch 
that | <£• Than by the Speed-Up Theorem V ie ^recognisable within 

tins — {h + n} ■+ ■ + n + £ i (1 + £ X* + h) + 2* D 

k 

Corresponding to Theorem £«*+ we have the following* 

Bug,™ 2JA 

tha class of linear predicates is a Boolean, alga bra 
whioh contains all finite predicates, 

PflOOF: The containment of all finite, predicates was shown in the proof 
of Theorem 2. 1 ** Since we art interested in the values of the 
recognitl on-line functions only over the positive quadrant in (.»>nj- 
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apace* we can bojjid the maximum. o£ two linear functions by a linear 
function. The result timn follows from Coicllary 2,**,l. Q 

Orra spending tc Theorem 2,3 va have the following. 

Lot !^ ba a predicate and M a call type which 
accepts (or re,: acta) ¥ in linear time. Then 
there exists a cell type K 1 which re cognize a 
T in linear tl?Le* 

PKOOFi Assume M accept? P, the ease of K rejecting ^ is similar* 
Since H accepts r in linear tiH, v» hare by similarity to Theorem 2,11 
that V wist be acceptable Iji tlrje (1 + £ )(m + p) +2 for any £ > 0, 
Let M fl be a ceil type which accepts f In time 2(n + u) + 2. Modify 
M" by adding a second layer which counts up t.o 2{m + n) + J and then 
rejects the figure if it luan't already been accepted by HV The cell 
type- sc constructed is M' t 

:-.;-« that the correspondence, of Theorer* Z*W to Theorem 2.> is 
act quit* complete, Namely we do not claim that W is effectively 
constructahle given M» It Is certainly effectively eonstructable 
given M and an integer k such that X always accepts f by titt* 
t ■ fc(m + n), cJowever! the ppoblea of whether or not it is possible to 
effectively compute such ft k* fliven just M and the taowledfe that M 
accepts in linear tide is open. H partial result is given by the 
fflll OMing theorem due to Mike FatErson [unpublished}* 



62 



Theorem g.14 (Pateraon) 

Gi™n a predicate ¥ r a cell type K which recognizes 
^ t and given that there Is an integer k such that K 
recognise s V in time k(a +■ ft), then the problen of 
finding * ninitjum sucit integer is is in general 
unsaleable. 

fROOFl Let $ be the ampty predicate. Given any Taring machine T", 
construct a ceil type M„ which behaves as follows, 1 1 simulates T 
for n. steps on a "blank tape, If T has net halted* it rejects the 
input figure at tia» 2 (a * n)* If T has halted* it rejects tha input 
figure at time 3( m * fl )» ^bu* M* recognise* ^ in tine 2[a ■+ n) 
■ ^" '"^ T never halt*, ajid in lime J (m + n) ^ fr T sTr-sntually 
halts. The Jesuit follows. M 

Similarly we have the following. 

Given a predicate V and a cell type X vhioh 
reocgnites V« it is in general undacidable 
whetiier or not K recognizes * in linear tizifl, 

PROOF j A a in the proof of Theorem ^. 1 if p let V be the empty predicate 
and for any Turing nachlne let K™ be a call type such that 

V. recognise* V in tin* 2 (a + n ) i{ — J^ T doesn't halt 
and M recognizes V in tin* 2(n n) <f ^ T halts* The result 
fallows ♦ 
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tte will see in the next chapter that son* predicates which would 
intuitively seem to requi;™ time an the order of m-n are in fact 

Jin-?.-\r* Indeed, the existence of a cellular predicate which is not 
linear 1* an open question. There are nany candidates for nen* 
.Linearity, but -Jiers are DC known methods of proving them to be non- 
linear, Tha only method of establishing minimal tin* bounds which is 
available is the Interdependence Theorem , which is only useful in 
establishing bound* less than m + n - T # Cols^J 1 in his thesis on 
'terative computers has established certain computations which Cfltnriot 
be don* La real time under restrictions on Intercsll cc-amiunl eat ions. 
However hi* model receives inf orma t± en from the external world as the 
computation, progresses and can be overloaded as he shows. In our nodal 
the input has already been digested at time t = t so no confusion of 
inputs is possible* Modified diagonaliiatlon arguments hava been 
tried by the author and by several other people: but promising as they 
seem, every such argument has contained a flaw. Finally we might add 
that this open question is related via Theorem 2.S to an apparently 
open question abom det^r^i^istic linear bounded autoraats . Assuming 
m = 1* Theorem 2.8 implies that if all cellular predicates were linear, 
t^en all predicates fi.e* languages} recognizable by deterministic 
LBA [using our particular model in which the input tape also serves as 
the working tape) could be recognized in time proportional to the 
square of the length of the tape* Hence the existence of a language 
requiring on the order Of n^ Units Of time for its recognition would 
show that non-linear gallular predicates exist. As far as the author 
knows, no such language has bean found. 

0* 



CHAPTER 3 
RECOQNlriCK OF TOPOLOGICAL IH VifllA?J T5 

In this chapter w* will study the reoopiition of sane specific 
piTedicates oVsr black And white fipires. All of these predicates 
de-pend only on topological properties gf the figure such as 
corow-utivt-tyi aijaple connectivity* nanber of coEpanents, Euler number, 
and sd on. The principal naguli of this chapter is a fundaniEmtal 
trails forma tl en cf figures which allows the construction of algOrltnms 
for recognising in linear time a vide Variety of those pradl dates* 
Han/ of these predicates have bean studied la Minsk/ and Paperv ' 
and in HLun and Hewitt^ * The interested reader 1 nay thus eenpare 
arrays with pereeptrons and pebble automata with regard to nee spilling 
these predicates » 

3*1 Basic Terminology 

Asaumption i UtuLasH nthe3Tri.se speeified t all figures and 
predicates In this chapter are assumed to be over 1 £ (i«* # black and 
white). 

We begin by establishing sees terminology., 

EBflilltian 

TWO cell* at U,J> and (p.qj are laid to be 
adjacent if i - p + j - a ^1 and a.^e said 
to be nelEhbsring if Si - p £ 1 and j - ql £ 1, 
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Two black C»lls are Connected if there is a chain 
of pai rvise adjacent black colls heglnr,inE; with 
one and ending with the other. Two whitw ceils a™ 
connected if there is a chain of palrwise 
neighboring white ceils beginning with one and 
ending with the other. 

Note the asjramatric definition af connectedness for black and for 
whits cells. Soma such a. symmetric definition is necessary if one is to 
■ J '.;tain such "nice* properties as the Jordan CurVa Thee ram + A nation 
Of connectedness wh Lch is symStrid with respect to black and whits 
can OS obtained by assuming thai each cell "touches'* all of tha 
neighboring Cells except the ones tc the northeast ar.d southwest* 
Tnis nctloh which is. derived from a hexagonal partition is, however, 
asyrasstric with regard to direction. 

We assume that figures are presented against a wblte background* 
Hence the following definition. 

Definition 

llti equivalence classes of black cells under the 
relation "connected" are called the components of 
P # Tha equivalence classes of white cells under the 
relation - COnnaeted H which do not Contain cells on 
the border (that la cells in rows 1 or a or in 
columns t or n) are called holes. The remaining 
aquiTaler.ce classes of white cells are lumped 
together into a class of white cells called the 



background ,. A component or hole which sextains ar,ly 
one call is Said to be Isolated, otherwise: 
non - igOlatgd . 

For example, the following figure has five Components (two of 
which are isolated) end twee helas Cane a^ which is isolated). 




Another example is in 3*8 checkerboard which according to eur 
definitions has thirty-two coajionents. all of which are isolated, and 
lie hoLea. 
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Given a figure-i one can c en at mot *n associated tree 
which represents the containment relationships 
between the background, the components, and the 
Holes* A figure and its associated ^ree are 
shown below. 
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Ivo figures which have isomorphic trees are said 
to be topological jLy equitta-lent * where by ignnja^jhic 
trees we mean iBanorpbl-c as labeled graphs Q-r 14 
unoriEnted rcoted "trees* 



;>e riniti.cn 



A predicate r is said to be topo^oglcally 
invariant if whenever P sna P 1 *p*j topological!/ 
equivalent figures! we haye P e ^ s — > p 1 * If „ 

3*£ An Exanplet ^CONN 

The first topoIOgicaLly invariant predicate we study consists of 
the set of all connected figures. 

Dsfinitlsn 

Iho predicate ^conn *-= given by 

Pfe rcorBW " v r * P contain* at msat one component. 

If we were to ask tha reader at this point to design, a Cell type 
which recognises TCGMNi ^ a first- attempt might Very well 'jc an erase - 
or.a-car.^onsr.t-snd.-see-lf-anything-is-lert algorithm. W* now describe 
such an algorithm. 

At timo t = the northwest corner cell e»its a scanning sigiia- 
s which begins to scan the array row by row in a back and forth 
manner until It encounters a black cell* This stage of the process is 
Illustrated in the diagrams on the following: page* 
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t ■ t * 1 t - 6 

At the point it which 9 en c minters toe first blade cell, two 
things happen. First of all a chain inaction of erasure Is set off 
■within the cosponBut tD which the black coll belongs. The black cell 
which was struck by s turns white and emit 3 an s^ase signal e to each 
of its four neighbors. The e signals ane ignored by whits cells, but 
an e signal striking a black cell causes it to vim white and eait e 
signals to its four nsighbc-ra* In this manner the entire component is 
erased 1 * 

The sec audi thing which happens when s_ encounters the first black 
ceil is that s changes into a waiting signal ¥, The waiting signal 
continues trie same tigaag scanning motion which s had been using, but 
does not Interact with either black or white cells or with e signals 
which are propagating around the array In various directions ■ The w 
st^/ial eventual Ly completes the scan of the array and strikes ana of 
the bottom cc-mers of the array* At this point the erasure of the 
component ia pjaranteed to be complete. 

The first three step* of the erasure process are shown in tha 
figure on the following pa^e. 



6? 













w 






in 




b 


§ 


J% 


M 













W j 








y// 


g 




i 


i 


^ 





























w* 


4 


s 


i 





t = 7 



t- S 



t - 9 



When w atrikes the corner at the end of Its scan, the figure 
contains one lasa component thin it did to bo gin Kith, All th*t 
remains to ba dona is ta gee if th& retaining figure is blank. This 
is accomplished by hairing the- y signal ruocund from the last corner as 
an accept signal a which scans up the a pray searching for a black sail. 

If a encounter a a black call, it is ^orwerted Jjitp a reject 
signal r which heads directly for the northwest Corner to cause a 
reject. If a. doaan't encounter a black call, it eventually strikes 
the northwea-i earner causing an accept. 

The case Of the blank figure ia handled by having the s signal 
abound 33 a When it completes its scar., 

Ifta- dbII type implicitly described above recognises connect! /it/ 
in time approjrijnately £ran and hence is not linear. The reader is 
challenged to find a fa& tar method Df recognising connectivity before 
reading on. A good (or bad* depending- on your point of view) ejxamplo 
ts keep in stnd while searching for a linear method is the figure 
illustrated on tna following page which has length and area Of if out 
£sn* 



72 




3,3 A Fundamental Transformation 

Ue now stud/ a transformation of black and whit* figures which 
will have important applications to the recognition of topological 
invariants by iterative arrays* By transformation *s mean a mapping 
fram blacii and white figures into black and white figures* The 
transformation will be studied in its awn right in this section and 
ita applications will be discussed in the following section. This 
tran a f c-ntia t i on was discovered by the author while he was attempting to 
prove that connectivity could, not be tecognltcd In linear tine* 
Since its tirst application was to show that connectivity could be 
recognised in linear tirje, we cai_ it the connectivity, transformation 
and denote it by T, The image of a figure P under T is denoted by 
TCP). 
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For heuristic purposes ve will describe the tran a formation as 
taking place in three Steps, 



Stap J_. Color all aoytheast corner calls 
of the black subfl£ure r*d. (That is if a 
cell is black and its eastern and southern 
neighbors are vJhlta t color it red.) 




Step 1 



Step 2 



i Stop J 




Rtep Z* Colcr all southeast comer cells 

the white subfigure black, (That la if 
a cell is white and its eastern and southern 
neignbors are black and its southeastern 
neighbor is either red or black, color it 
black J 

Step ]5« Color all red calls white . 



Properties of Tt We now informally describe the properties of T* 
The remainder of tbis section will be devoted to proving these 
properties in a series of lemmas. If one considers repeated 
applies t Long of T to a f igure , One observes that each component is 
reduced to an isolated component which then disappear a. Distinct 
components renain distinct and either vanish at different points 
or at the same paint at different tlaes. Similarly, each hole is 
reduced to an isolated hols which then vanishes with distinct holes 
remain ir-F. distinct 3ji i Viniching at different point s ar different ti^es, 
It is easy to calculate exactly hew many applications of T will be 
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required to reduce a giYan component or hole to a single cell and 
exactly where that cell vill be. The entire figure, tio natter how 
complex* vill be deduced to the ai: whits background in less tuan 
m + n applications of T. 

Tc Uegin y roving ihe above statements* we need some way of 
relating the components of F to those of T(P}» This is done in the 
next four lammas by using the concept of a stationary point. 

A cell (1,J) is called a stationary ^Olrr. of P if 
it la blacfc in both P and t(p). 

Note that the stationary points are exactly those black cells in 
P which are net southeast corned of th* black subflpira of P, 

Every nonisolated component of P contains a 
stationary point. 

PRGOF: Let C be a non-isolated cemponent and let * be a northwest 

cairier of C, Then X RUSt be a stationary point for otherwise it 

would also M a southeast corner =jid hence C - [x > vc\i:.?i bu i sola tod* U 

Lerana 2 

iwo stationary points ar* connected in P if and 
only if they are connected in T{F}- 

pjKjqPf r == ?M l*t x and y be two stationary points of p which are 
connected* Then ay definition there exists a sequence ^ . x t . t . . . x^ 
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of distinct pairwisfl adjacent black calls such that x = Xq and 

y = * n « We use induction on n, If n = 1. then i ia adjacent to. y and 

we aie dene* If a «= 2, then; either i, 13 also a stationary point 

in which case we are dons, or x- is a southeast comer., tn the 1 attar 

case va have the situation depicted in the fig-jre below, possibly with 

x and j interchanged and one sees that the cell z will be blaclt in 

T(P) nc matte™ what it* color in P. Thus x and y are connected in 
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^ 



a, 
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P T(P> 

Nov assume n^3. Cbserve that any chain of distinct, pairvise 
adjacent black colls cannot contain two consecutive southeast corners* 
Thus either x^^. or x^^ is a stationary point and we may apply the 

induction hypothesis to the chain x^ x k and x^* .„ r * 

where k is either n - 1 or n - Z* Thus x is connected to y ±n r(P> 
via V 

L^^J Suppos* x and y are connected in T(PJ and let 

*Qt x ] i be a sequence of pairwiae adjacent black cells in 

7{?) such that x = z^ and y = x^* Again vb use induction and; again, 
the cases fcr u = 1 and n = 2 with x a stationary point {of P) are 
trivial,, so assuj&e n - 2 and jc* is not a stationary point* Then x 
must have been white in P since it is black in TCP). Hence x- am at 



n 



have satis fled the eDnditiisnE iji at*p £ of the description of T and 
the situation depicted below nuat have existed in P, 




We know that X and 7 are adjacent to X, and are stationary points 
of P. Therefore it will suffice to show that all stationary points 
of P which are adjacent to x. are connected in P to the cell labeled 
z. From the diagram above we see that the eastern and southern 
nei^ibors of Xi are indeed stationary points of P and ar» connected 
to s, Mow consider the northern neighbor of x which has been labeled 
(i in th« diagram belcv. 




Assume n is a stationary point. Then n cannot bs a soutnaast corner 
and hence either x- or n 1 is black* But x 1 is wbits, thus n 1 Bust be 
alack* Therefore if tt is a stationary point, it is eorjie-cted to % via 
n'. A similar argument holds for the western neighbor of x , This 
completes the case for n K 2* 

The remaining cases for n > 3 follow as before f ron the 
observation that either x^ or x fj _ 2 is a stationary point, although 
different reasoning must he used to make this observation now since 

Xp is a chain in T(P), D 
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Cdnblniiijr leranas 1 and 2 with th* obs#Fva.tion that every black 
sell in T(P) is frith* p a stationary point tf P w ia adjacent to a 
stationary point* ve have abownc 

Leinnia ^ 

There Is a sanani'oai one-to-one correapondanee 
between the- nan-isolated components of P and the 
components of T(P)» 

We new state without proof the corresponding lemna for holes, 
vhieh can be proved by methods similar to those a&ove. F£oweTer+ a 
slightly different eono-apt than that nf stationary point must be uaed 
since sores holes such as the one illust-ated belw nave no stationary 
points. 





TtP) 



Lenta ^ 

There is a canonical one-to-one correspond-ance 
hetw&&n tha nen-isolatEd hoies of P and the 
hole a of T(F} f 

The following lemma should be obvious by nov. 
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Leiwa £ 

If P contains so isolated c aropone.nts or holes, 
then P and T[F} are topologically equivalent* 

We now 3hov how to compate the Hiunosr of applications of T 
required to reduce a component to a single aqua^B and where that 
square will lie. Identical results can be prcved for holes using 
similar arguments. 

Definition 

Given a component C of a pattern P T let 
T^C) - 
t{C) - the canonical image- of r* (G) mid*? 

T for k a (provided it exists) 
n(C) = Din |_t| row i intersects C { 
w{C) = Bin {j j column j intersects C J 
•w(C) = nfljc (i + j i | (i,J>* C } 

Note that p(C) t »(C>» "d **(0 represent three line* forming a 
triangle such that C lies within the triangle and touches eaoh line 
as shown In the figur* below. 



w 




We will show that the cCnpar.cr.t Vanishes at the cell indicated by 
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the dotted lines and that thfl number of applications of T Mquiredt to 
aehiflTO this ia equal to the distance frran thi-S cell to the 39 line. 

i^-mrua 6 

If C is a ndft -is elated component, than 
n(T(C)) = n(c) 
w(T(CJJ = w(C> 
s*(T{C}) = s*(C) - 1 

PRflCfft Ql(T(C)) ■ n(G)| It ia clear that n(T(C) ) £n(C) t since 
each blacjt cell in T(C) Is either a stationary point [of P} or is the 
western neighbor of a s/tationary point* On the other hand, if (i, j) 
is the western most point of C which Has In ray n(C), then (i,j) must 
be a stationary point and nance n(T(C}) < n(C) # 

]jw(T£c)) ■ w£C)] This result follows imediatoly from the above 
and the syscEtrjr of T with respect to pc-rtfl and west* 

[s*{T(C}) = se(C) - l] Any call (i,j) In such that i + J - sa[C) 
must be a anqtfieast corner of C and hence i? adjacent to a stationary 
point (p f q) such that p + q » »{C) - 1, Thus se(T(C)) £ se(C) - 1, 
On tho other hands all a«ah cells (l»jj do not appear in T(C), so 
setT(C)} ( s*{£) - 1. Q 

Lemma 7 

If C is * non-is&lated Component* than 

T^ L J (C] is an Isolated Component located at 

(n(C),w{C)) t where k(c) » tt{£) ■* n(C) - w(C). 

FSDQFi By lftnma 6 we have k{T[C)) = k{£) - 1, Thus by induction 



ktlM^tC))) = j^g) m |j(cj . q 4 which can only hold for an isolated 
component. That component mist be lc-cated at (n(T^ C '(C))»w[r^ C '(C))) 
which is (n(G)» v{C)) by Lemma 6* U 

Lamina i_ 

If P is an n-n ripuw, then T 71 "* -1 (Pj is the 
all vhlt» figure. 

PRCOFt Apply La««a ? and the faot that k(C) < n +■ n - £ for any 
component C of F* ^ 

If P is an m*n fifrure containing e components 
and a holes, then the total number of isolated 
components appearing in the figures 
r, ?(F), T^F), ... ( T»*" 1 (P) is e and the 
total number of isolated holes ia h. 



FEOOFi Immediate from Lemmas 7 and o. 

3-4 Liraar 3e cognition of Topological Invariants 

The connectivity transformation ( T» described in the previous 

Section forms tlw basis of ^hft cell types ta be presented Ul this 
section, These cell types all have two common characteristics i 

i) They recognise topolagically invariant predicates 
in linear time. 

11) They ; crisis - ; nf tvc layers, a lover or transformation 
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layer which carriea out euwesaiTe CMnnMtivity 
tranafornuitiaiig an the initial figure, and an upper 
or ocseriFHtion layer which watches the transformations 
taking place, gathere and processes information, and. 
finally cotnas to * decLalmi about tna figure. 
The tranafcnnatlan layer oan carry out stieaeasive applications of 
1:W Connectivity transformation, T> *t tits rat* of One transformation 
every two units Of tine *a frUpvs, At time t= {nod 2) the lata at 
figure P la represented in tha transformation layer. At time 
t 5 1 (sod Z) each cell haa entered a atate which represents not only 
its own atate at the previous time t but also that of its southern 
neigh bor. Each cell HOW has access to ths informs ti-ori naoesaary to 
enter the appropriate ata be ill T(J), 3y the next unit of tijne* 
t = Q {sod £]* the transformation is complete, flia intermediate step 
is nageaaary to- pass Information around "-he corner 50 that a cell in 
the white state can detsraioe the state of its southeastern neighbor* 
(This step could ba eliminated if diagonal connections were allowed*) 
The process is illust rated, below. 
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Th& observation layer watches for the disappearance of components 
or holes in the transformation layer and generates appropriate aignals 
at each such disappearance.. These signals are then proceaaed and a 
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decision is reached. In seen case a it Is necessary for the northweat 
earner cell to know that It his received all the information required 
for a decision. In the&e eases the southeast comer call. sends nut a 
tilling signal which propagates through the ajray at an appropriate 
ra.t*i. Whon the timing aignal neacbea the northwest corner ceil t all 
other signals niiSt have praeaded It, and a decision Can be made. 

We nor present SCta* topoloslSaliy Invariant predicates which are 
linear* In each case the proof that the predicate la invariant, res ^5 
en the construction of a cell type which recognizee the predicate in 
linear time* As explained a Dove, all of these cell types operate in 
two layers wivh the lower layer being the transformation layer. Thus 
to describe any giver, cell type, ve need only do scribe tha observation 
layer. 

ineorem 3 ■ 1 

V^OriH ^- a a i-inaar predicate* 

PROOF 1 Signals are only ganerated by vanishing c naupanen t s + As each 
signal is generated it heads for the northwest corner cell. Ihe figure 
is rejected if more than one auch signal is received at the comer. If 
two auch signals collide an the way ta the corner* they carabine to 
torn a reject signal which, whan it reaches the corner will cause the 
figure to be rejected, 

Definition 

Let ^Kj C be given as follows 

P e ^c,c i — f* *H components of F a^e aLxp\y connected.* 
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Theore m. 3*2 

^£ C is a linear predicate. 

FIWUF: Signs- a are generated by vanishing nolea. If the northwest 
corner receives any such signal* the figure is rejected; otherwise it 
Is accepted. |J 

The abcva ixa predicates are special pases of a more general 
predicate* 

fruition 

For any c ,b ,^,1^ su,ch that U <c »c ,h. ,hg ^ «■ 

let VV'^ t* given by 

5 a £a SCj and ^ ^h£h 2 
where c is the number ol' Components 
in F and h is the number of holes. 

The aram 3.3 

For any 0£cj iC^h^hj ^ » T tns prsdlaai* r£ £ 
is lln+ar* 

PfiCC(F: This is a simple adaptation oi the aethods employed in 
Theorems J.1 and 3 + 2* 

In taa abair? theoreas we have rwerely used our trans fcrraatisn to 
count ponpaneats and holes* But Lemma 5 indicate a that the 
connectivity transformation pra serves additional topological 
information. By introducing a slightly different mode of operation in 
the observation iayer, we may take advantage of this fact. Consider 
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the following predicate. 

Pacini tion 

Let %mi be the predicate given by 

( So component of P la doubly 
P g fjfoc ^^ < connected £i.e* no consonant 

f of P has exactly two holes} # 

Sow f^^ is not of the form V^ , bat injvar 1 the less we have 

Tries irem 3*4 

^.r.j. is * lijiear predicat*. 

PROOF: A3 before signals are generated, by vanishing holes* but unlike 
pre vi sua eases they do not ijfuediately head for the northwest corner* 
Instead they remain positioned over tho component In which they were 
embedded. As these components gradually shrink and shift under the 
action of the oD-nneotivity trans formation + the hole signals shift se- 
as to remain pesiiio-ned aver the components in which they originate d. 
3y the tiete the component is finally reduced to a single cell, ail Jwle 
signals associated with it have collided and a signal generated by 
their combination is centered over the now t sola. tad component. In 
the ease of %idc this combined signal would indicate whether the 
component had originally contained 0* 1* 2, or more than 2. hale a* In 
ihe case of 2 holes, a reject signal would be generated which would 
cause the figure to be rejected* Otherwise bath the component and 
the combined hole signal vanish at the next unit of time, Li 
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The method of making a signal generated by a vanishing hcle 
remain above ths component In whi-cn the noXe was embedded O&n be 
applied in a dual maimer. Thus the prwdiCEite "'no hoi* contains 
exactly two coaponents" could be recognised since it is Just the -dual 
of ^f W i This procedure nay be esctendad as in the following theorem. 

TJib Oram 3»^ 

Given any figure Q. let V^* b* the predicate 
given by 

ls topologicaily 



[ Pi! 



equivalent tc Q+ 



Then ^=jj la linear* 

PflOOF? Retail th&t twC figUrss were said to be tOpologi&ally 
equivalent if they had isomorphic associated trees. Thus given an 
input figure P, we can begin cosputlng its associated tree. If at 
any paint in the conputation it becomes apparent that the tree of P is 
not isomorphic to the tree of Q f a reject aignal can te generated. 
Otherwise the computation will continue to completicn and P will be 
accepted. The eoMputation of the tree of P can be carried out in the 
following manner. 

When a hole vanishes [assuming there were no components located 
in that hol*) t it generates a signal which represents the subtree 

This signal floats above the component in whinh. the hole waa located. 
If two aush signals should collide ■, they □ do bine tc fc-nn a signal 
representing (a) » [Extensions to more holes is clear.) When 
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eventually the COMponent Tantshea, it replaces ".he signal \^J by « 

©0 

sdgnal (s) • This signal than floats a hove the hole (or 




possibly the background) in which the -ccmpcnent waa located * The 
process now cor.tir.UBE. In general the signal generated ay a Vanishing 
suhfieure will represent a trea which is obtained from that aub- 
fi^ure's associated tree by adjoining: a nods marked P E" to the root. 
n:\er: r;vra <nich signals collide, they Join to fomi a signal representing 
-iie tree ohtained by identifying the h a n nodes, 3y the time P has near, 
reduced to the background and all signals have merged at cell (1 + 1)p 
the resulting signal will represBnt the tre-* associated with P. 

7ne process described *bove is workable but for one fact. Since 
there is infinite variety in associated trees and. subtrees* we need 
ixr\ infinite nunber of signals to represent them* In the case of 
recoiling *£=£ this restriction is not effective since we aeed enly 
en-ygb signals to represent all the possible subtrees which could be 
formed while const meting the tree associated with Q, /inytime two 
signals collide or a component vanishes in such a manner that the 
resulting signal has not been provided for, it indicates that P J. a not 
ficuivjj-ent to (J and a simple reject signal may be produced instead, J 

Corollary ^5*1 

Given any figure Q» let ^cq be the predicate 
given by 
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tha associates tree of P 
P * V^q ^i V < is iaOGiorpihis ts a subtle 

of Q. 

Then Vt^ la J- 1 ^*^ 

PROOF: A cell type which recognizes T^-q iiay bs constructed by a 
simple adaptation of the ?3athDd of Tnecrem '} *$. U 

Corollary 3+£+g 

Given any finite s&t xf of figure a, let ^j be the 

predicate given by 

f there exists an 5 6 jo such that P 
( ia tQjralogieally equivalent to S. 

Then l(£ is linear. 



PROC?: The result follows iflwwdlately frttn, Tne^rem 2,12, since 

% = 4, V-S ■ 
" 1*4 ' * 

Thara aeems to be an endless Variety Of topologically invariant 



predicates to which the connectivity transformation say be applied 
to obtain linear results. We will conclude with the mention of 
two predieat&s which seam interesting and amusing » 

Definition 

Let Ijj = |b>w*S.f J (representing blacky white, start h 
finish). A figure P over 1^ is Said to be a maae 
provided it contains exactly one occurence of a 
(start) and exactly one occurence of f (finish). 
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A maze P is said to be solvable if the calls 

■ ■ 

containing the a and, f are connected by a chain of 
pmirwise connected black eslla* 

Theorem 3.,lk 

L** ^We *» U 16 predicate over 1^ given toy 
Pft VJ^jf ^^ P Is a solvable md2«. 
Iben Yf-, ATE | Is linear, 

BWfflF] GlTen ft figttre P over 1^. it can be determined in a linear 
amount of time whether or not it is a maze. If It is, a two _ayer 
connectivity type array can determine solvability in linear time by 
having the fi and. f float above the components in which they wart 
enibed.de d< They will collide if and only if the Raze is solvable* LI 

In view of Theorem 2,11, the above resnlt says that Wft can teat 
whether two given points in a figure are connected in tlae 
(1 +£ ){«+«] + £. But in many figures the shortest path between 
such points is on the order of ^iBh iii length. TtlUB we can determine 
that two points are connected in an amount of time which is leaa than 
that required to transit a signal along the shortest, pa'Ji In the 
component connecting them ( t ) + 

An application : The i'insl predicate we consider is included a a 
a highly inpraetieal applieaticn of the foregoing mexhcds. Let any 
figure over IV represent a nap of acme islands In a lalte with uhite 
representing water and all other symbols represent in r land* Lot b 
represent a bane pld -if grcund, s a plot on which a sheep is standing, 
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and, f a plot on which a sheep doff (JidoJ 1:; standing. Then it will bft 

of relief to shepherds- who keep thali* floeka on islands to know that 

the following- predicate is linear* 

T every isian-d which has aheap hag 
I A aheep diDga 

The proof is Omitted* 

ttijg ifir Ptmei]Jl«ia : &>e might as* for a thrue-dlseinsiOnai analog 

to tha connectivity vranafonatiqn which would allow a Uipb*- 
dimensional iterative cube of automata to iesi in linear iiras whether 
an input figure [inp«t solid?) La connected* Ko s.Lch transformation 
has bften found;. Indeed* one can see that any transformation which 
would handle th-iae-dixen^ionai tases nust be aomewhat mc:na complicated 
than a simple. BrjirLrJc-the-COmponents-tD-a-ainfila-polnt approach, since 
one san have figures such as two intsrlocKing rings which rcust be 
unlocked be fere being shrunk* 

As a problem interne diate between two and three dlnienEi&na, ona 
might study the prolan of recognising connectivity in nmlti-rleirel 
maaes of fin He depth, Ihe a&liitian in linaar time of roulti -level 
mates would allow us to relate arrays and tuO-ciir.Ensional finite atata 
autossata in an interesting manner ■ 

Theorem 3»3 

If multi-ieval nazes are solvacle in linear tin* 
by iterative arrays* then any predicate r*eogn4Ea.ble 
by a two-dimensional finite state automaton is 
reeogniiaul* by an array in linear tire* 



PROOF e Assure, that cultl-level 29Zes are solvable in linear time* 
L$t A be a JTijcHd tWO-dijnonsional finite stite automaton which 
operates or- tlpirss over the «t I. Then construct the cell typo y 
which operates as follows* At ti&« t ■ the figure over I ia present* 
At time t = 1 th* irray has created an 3-level aaz.e, where a ia the 
number of states k A, Each level represents a state of A* If cells 
(i,j) and {p,q) ar* adjacent and if the initial input at (,i,J) *ould 
cause the automaton to go from state k to itate r and wove from (iij) 
to tu>q), ther, a q onne ction between laved k at (iij) and level r at 
(;:i,q) is established in the raze. Thus we s«e chat by tine t ~ 1 the 
array has constructed a nap of the- ttovewents of A orer tha figure. 
This nap contains tha path actually traced out by A when it is placed 
on sell 0.1} in its starting state as well as many other paths 
corresponding to state /location configurations which A would never 
actually enter. The qua at! on fl does A accept the figure?* now becomes 
the question "does tha multi -level muse have a solution?* (using the 
initial state level at (1 P 1) as the start point ami. any accept state 
as a finish point) * By assumption this problem is a linear problem. 
The author has tried several Rodifi. cations- of the conn-activity 
transformation in an attempt to find a successful method of soivin^ 
multi-level mazes in linear tiF.#, but none have worked. Multi-leVel 
nazves can certainly be solved in time proportional to n-n, but their 
linearity is still an open question. U 
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3*5 Euiflr Number 



The Eujier number of a black and wnlte figure is 
the number of component g in the figure minus the 
number of holes, 

Hinsky s.nd Fapert show that predicates depending in a 

reasonable way on the Buler number &f a figure ara easily racagnlnd 
by varceptronfl. Their method 3f determining 'be Ejler nun 'Mr is to 
perfpffl a weighted, a^-an over certain subfigures, Namely, each 



cccurrance of the subfigures 
occurrence of the- subfigures 



ir.ci 




i counts +1 and each 



and 



Counts -I, They showed by 



induction how the SUffl of the*e integers over a figure is equal to the 
Euler number of the figure. Their- somewhat obscure motivation for this 
process is that |gy is analogous to a vertex > 



,^J 



tc an edge, and 



^^^ to a face. Actually there is a quite simple interpretation of 

their result* If we agree to deposit the cc-jnt £*t) far each of 
these subfigures In Its southeast corner square and if we agree to SUU 
the counts deposited in any given square, vb fine] that only two hb*b 
arise where a non-zero count is attributed to a square* These 
correspond to the subfigureg L an: I R belw* 
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i : .ow think of an observer who starts walking along the outer 
boundary of a component, keeping the component op hi a left, and who 
eventually returns to his point of departure + During his stroll he 
will have wade a number of left- and right-hand turns. Since he was 
on an o^er- boundary a hs must have made a total ;f fey i" nor* left than 
right turns in returning to bis starting point. If instead of 
counting all turns, one count a only those left turns which change 
direction from north to west and only those right turns which change 
direction fi*om vse*l :: north, then on* will have exactly one mere left 
than right turn. But theae special north-to-west and. wast-tD-nortli 
tuiWs occur only at L and R confl gyrations respectively. Thus an 
outer boundary has exactly one more L than E ccnfiguratiiai* Similarly 
an Inner boundary has exactly Dne more fl then L configuratiin* Hence 
the sum over a f injure of the weighted L and R cenfi gura ttonsi is equal 
to the difference between the numbers Df outer and inner boundaries* 
But this is just the difference between the number of componenta and 
hole g + which in turn is the Euler number of the figure. 

As an example , the figure 




would produce the following distribution of counts. 
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We can easily design sui array which would by time t = 2 ha^e 
transformed an original figure into its corresponding pattern of +1'* 
and -1's t Thig might be a natural first step in setting out to recog- 
nize a predicate which depends an the Baler number. Consider Tor 
example the predicate, ^ EU l£f* whll! * contains All those figures 
having- positive- Eul*r numbers, After trans forming the figure into a 
distribution of count a T the problem becomes simply to- determine 
whether there are more +1 f e than -1 r s. 

Ttils can easily be done in time- proportional to a -ft. It 
certainly seacs that one should be able to detect a surplus of one 
type of symbol over anc-tfcer In linear tisa, but surprisingly,, this 
question remains open. 

3-6 Topological Hatch Prob3ea 

A prise candidate for a nan-linear recognition problem is the 
topological match problem. In this problem we present two black and 
white figures to the array and ask whether or not the two figures are 
of the same topological type* The best known times for solving this 
problem, are on the order of (m*n) . We will mention several .methods 
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of solving this problem below* 

itopre? entitle pairs off figures i Let us make the following 
convention for representing pairs of b^ack and whit* figures* Given 
two blaci and white figures we wish to oospore, V* first adjust than 
to have the iame number of row? 37 adding txtra rows of white calls 
to the bottom of whichever figure has fewer rows. The figures which 
now ha t* the same number of rows are placed side by side, separated 
only by a Single column of red, cells, the total fipire consisting of 
-the two black and white figures and the red divider constitutes the 
input to our array* We will refer to the two figures as the left 
figure and the right figure . An array which is to solve the 
topological match problem will accept only those figures which are in 
this form and in which the left figure is tepologically equivalent to 
the right* 

Converting a figure into tree rapra aan ts tl on : It is possible to 
design arrays which 30lve the topological match problem by dealing 
directly with the figures as initially presented to the array, It is 
also possible to first convert the figures into representations of their 
associated trees and then perfona isomorphism, checking on their trees* 
Since topological equivalence of figures was defined in tBras of 
isomorphism of the associated trees, we feel the tree coEpariacm 
method is conceptually cleaner as well as nuch easier to describe. 
The process of converting a figure into a representation of its 
associated tree appears to require on the order of (m-n) units of time 

to cempiate, Since all known methods of comparing figures or trees 

2 

for isomorphism take on the order of (m-n) unite of time* the 
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Conversion process does not alter the functional for* of our recognition 
tise. By using speed-up, we may compensate entirely for tilt -lm6 spsnt 
Iji conversion* 

the conversion process may ba thought of as taking place in the 
following two steps ^ 

i) one cell In each component or hale is chosen to 

represent the corresponding rods in th& associated 
trea and 
ii) the 11 ode 9 are connected together by a pathway of cells 
In a manner which represents their connectedness In 
the associated tree. 
We now describe a process for converting a figure Into a tree in 
which these two steps overlap. Since the distinction between back- 
ground* Mtnponettt, and hole will be relatively unimportant in the 
following discussion, we will use the term area to refer to any of then* 
The background is by definition one area, butt it nay be in fact 
die connected by a component which touches the edgea of the array In 
several places. A disconnected background represents a difficulty 
for the process about to be described, since it reoogniies the 
integrity Of an area hy it* connectedness* Va will assuma that the 
figure io be processed baa an all white border and hence a connected 
bae:-i0raur.d. Any figure which does not have such a border may be 
treated as if it did by having ~*he border cells of the array nretend 
to be double cells With the Outer ceJLl beiji£ whit*. 

As an ex.ir-.TT. p. we will follow the figure piven in the following 
diagram through it* ConTerslCn Lib a tree representation* 

9k 








Our process involves a row by raw scan of the en -Ire figure by a 
signal which we will call the scanner. The scanner will travel f rem 
(jest to east along the top row* then more south one row and travel 
from east to west along that ?nu t msvn south a row and so an* Each 
time it strikes an area for the first time, the scanner pauses while 
that area is processed. Ihe processing d£ a new area has three points 
of interest j 

i) jfhe cell on which the scanner is sitting bsccces 

marked as the node corresponding to that area; 
ii) a linking pathway is established between tnls newly 
created node and the appropriate node abcve it in. the 
tree representation; and 
iii] the entire area is marked by a contagious process so 
that it will be recogniaod by the scanner as having 
been processed* 
Shortly after the scanner has completed; its scan, Lhs transformation 
kill be complete* 
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At t = 1 tha gunner is sitting en ce^i (l r l) and be^ina waiting 
for tha background ta be processed. We will represent the location cf 
t'h«j Mannar by drawing a gnall triangle { * } in the lower right-hind 
earner of the call in which it ia located. A cell which has Become a 
node Will be denoted by a he* 1 ^ outline ( Q )* Thus we have 



t - 1 




In the case of the hackpreund+ no connection to anutber node is 
matte. The contagion which marks tha hacks^aund as having been processed 
is .-i.r.i.Iii- Ll: '„ho oor.tagiouR e>r.iBire-. uy*d T.s recogr.} r e ^-. CNIi in 
Section 3*2, but with two Important differences, First, each call 
which catches the ?ontft^ion keeps a permanent record of one cf tha 
directions fren which the contagion arrived, We will represent thi.-? 
r&eord by a small arrow within each call which bagins in the canter of 
the cell and points in the direction from which ths contagion 
arrived ( -J ), Second a -eehanisK is provided which a How a the 
scanner to know whan the contagion which it has created within an area 
has completely covered that area. As each new cell catches tha 
contagion, it studs a signal, called a dot* back along the ays tea of 
arrows which ultimately leads to the scanner, Thus as long as the 
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•c :j:-. !>n gj. ■■-. ". ■ :- 1 1 .v.ir li " - ■■ p "e.i :i , ">-* r Qfl r„r,e r wi. ': 1 cor ti r. ■!* . o re ce i ve 
dcts and will not resume its uear.. Since ^he contagion idovbs away 
from the scanner at one cell per unit tins and since dots travel at 
on* call per unit time, the normal frequency of arrival of dots at tha 
scanner Is one dot every other tine interval* Thus if two tice 
intervals pass without the arrival of a doti the spanner xay resume 
its scan. Ws will represant the presence of a dot in a celL by a black 
dot ( | «-»| ), Ona might think of the contagion as a Spreading grass 
fir* and the dots as particles of smoke drifting back from the fire. 
'Jtie signalling Mechanism provided by the dcts is necessary gince _ ^e 
scanner recognises nev areas by the f*ct that their ■cells have not 
been infected by contagion. If the scanner resvjnel scanning cefcre 
the contagion stopped, then it would not be atle to distinguish 
batwasn ceils in newly en counts nod areas and Cells in old areas to 
which the contagion had not y*t spread. 

Let us now look in on the progress of our example. (Notei the 
diagrams which follow are Intended as an aid to understanding the 
process and do not necessarily represent all the information present 
in each call, ) 



t = 2 




0? 



t = 3 




t*k 




Th& contagion Bn^ signaling 1 process are under way. At t = 1 1 * 
the contagion brunches fc-r the firs:; time. 



t = H 




itf 



t ■*> 15 




t = 16 




At t = 16 vb observe the first ease t>t the ocn"Ugicn spreading 
through a diagonal conne c ti an between white cells (fron cell t 1 **?) to 
CG-11 (5*®))* H^ti that the contagion takes two time unitg to pass 
through the connect! en because of our nearest neighbor a^del* Bote 
also that cell (4,9) has generated a second dot at t ■ 16 to avoid a 
gap in the dot sequence whioh ^oald be created if it slr-.piy waited to 
transmit the dot gerstratsd bj cell [5*6% In general any white cell 
•which catches the contagion and: which has diagonal white neighbors 
will generate a. second dot in this Manner* 
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W'g new watcJn -.tie contagion cosM to an and,. 



',■? 




t = 18 




Note that the contagion arrived at calls [7,6} and (S^lo) fi*an 
two directions at -MIC* and that these bells roaqa A chGlee of direction 
Any choigfl- uill d<?» 

Wo now see the last of the dots begin to moTe, toward, the scanner* 
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t - ^^ 
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Bf t ■ 35 the last dot tsas arrivsd at tha scanner* 



35 
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At t = 36 the scanner sees ihot no flora dots will arrive and by 
t = y? It has begun to continue its scan* 3y t = ■■»? it has completed 
ita sdafl af the first row T dropped d-cwn sne raw h And. has encountered 
an unprocessed cell, Ctrlc* again contagion ■within the 1 new area begins:* 
In addition we now aee iiis linking process baffin to take placs* ~-.« 
pa.hway o cnnect^r.g the new node to its parent in the t:rae Is grawn 
cell by call siaply by eorunectinj; the nod* cell to the cell from 
which the scanner arrived and can-tinning to gr™ the pathway in the 
direction indicated by th* arrows. 

The first three steps are shown below. 



t « fc? 




t - 1*6 




'02 



t ■ 49 




Hi' t = 57 the pathway ha* b*M completed 1 but -.ha contagion is 
still spreading 



t « 57 




3y t = ?3 the contagion is dead and the last dot has arrived 
back at ths sCanttftr* 
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t = 73 
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^ t = 97 a third area has bean prscassad and linksd and th* 
a earner is preparing to centintie ita acan* 



t = 9? 




At t - 173 tha scanner ha3 caopletBdl its a can and all processing 
is complete* 
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17? 




Alvhsugh the process waa complete in our example by the timft the 
scanner finished I -a acan f this Is not always the. gaes, Ihe scanner 
waits at each node until the cantagion. is dead* but does not wait until 
the connecting pathway has been e-atabliahed. Thus it night be the 
case that some pathways Are atil_ net complete by the time the a-canner 
srl-iVfls at the end sf it a scan t Since the longest pathway may be 
about |a*n in leng~tn N we icust wait this additional amount of time to 
insure that proqasaiTig- ia complete* 

The entire proceaa of ccnTerting a figure into a tree represent 
tation take a time proportional to m^n, Ihe scanner i9 in motion for 
about a^n units and at re at for a total time less than Di" equal tc 
twice the- sum of the areas. Counting Lhe waiting time for ample tlon 
of connections*, the entire- process will ba eOKpiete in at most 3|i(m*n) 
units. 

The ^ree which was produced in our axanple contains sir nedee 
corresponding to areas and two false nodes created by the confluence 
of pathways * Ike false nodes located in cells (2,6) and (2,10) are to 
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be ignored In our interpretation of the results. The CWation of 
false nodes is a neceesary eTil since the trees we are trying t* 
represent may have nodes of arbitrarily high degree. One way of 
ignoring the falsa nodes is to think of a tree -like structure of loops 
rather than of an actual tree* In aych a loop a true tune the descend-* 
ents of a node are threaded on a loop which begins and ends a- ihe 
node, The dlagran below $hau s a. trsa T and ths corresponding loop 
structure L» 



\ 




The algorithm for ■converting fibres to trees which was described 
above can be- modified to produce SUCh l*Cp Structures simply by 
gluing the connecting pathways doublet The loop structure, 
corresponding to our example is shown below. 
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Catparing trossi Having shown how to c-onvert figures to tree 
representations, we new must deso ri.be hew two tree repreaentBtians 
»a,y !■■? compared far i 3«no rphi 3m + The methods to be d,e s cri be ci will 
maica use only of ~he cells which actually tors, the tree representations 
for the left and right figures, plus a pathway of cells connecting thu 
background node Of the left tree to the background node of the right 
tree* The pathway connecting the background nodes is used for 
cotnjEn\mi cation between the cells in the left and right trees. Imagine 
now that wc have deleted all cbIIb from the array aaraapt those 
comprising the tre*a and the communicating pathway* If we grasp the 
left background nod* in one hand and the right haafcK round node In the 
other hand and lift, the trees will untangle and hang down, Che has 
an imaga of something like the fallowing diagram* 



communicating 




IS? 



This Is the torn in which we imagine the cells to be arranged 
purely to avoid thinking about their actual embedding iri the array amJ, 
to ne able to use words such as "abc^e* and ^below" in describing the 
relationship between node?. Since no path lengths vers altered in the 
lifting pruGBSdt COmmunicetion tines have not been altered. 

Recursive srftthodi The first aethod of is<m erphi m - checking to be 
considered is a straight- forward recursive procedure. We think of 
two obger-vers, or.o standing on each background node, who can speak to 
each other Via the ccemunioating pathway-. Our observers agree to 
check whether the tree a are isomorphic. They do this bv first 
conp^ring the degrees of the node a on which they are standing. If the 
decrees differ, then the trees are certainly non-igcKorpbic and the 
process te.TEinates. If the degrees a™ both, cero (ignoring the 
c-a™wni cation pathway) t -then the trees are certainly isomorphic and 
the process terminates « If the degrees are equal but non-zero, then 
further checking is require d. The chedring involves comparing each 
subtree below the node on which the left observer ia standing with 
each subtree below the node on which the Tight observer is standing. 
The compari sang are carried Out in a recursive nanner by thu observers 
themselves. They begin methodically to make ail pairwise comparisons 
of one left subtree with one right subtree. Each time a Matching 
pair is found* they are marked and eliminated from consideration, 
Eventually either a one-tO-One correspondence of subtree. 1 ; will be 
found* in which ease the trees are isomorphic, or a subtree will be 
found which has no Batching subtree, in which case the trees are 
non-isoBorpMe, 
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>=■(: rlptlsn gone rati aft method ; Ihe second aethod of isomorphism 
checking might bo oil led. the description generation method* ftily th# 
central ids* will be sketched here* Assume that we have established 
a set oL' conventions for describing finite rooted trees by strf.ngs of 
symbols. Furthermore assume that our system is canonical in the 
sense that two trees which are isomorphic have identical descriptions. 
Such a system could for instance be a parenthesis system in which a 
tree ia described by an opening parenthesis followed by the descriptions 
of each of Its subtrees in lexicographical order foil cued by a closing 
p£--enihe5is ¥ Having established such a system, we have the cells 
in a tree representation, carry out organized activity in such a 
manner that the cell corresponds n& to the root node emits the 
canonical description of the tree* Given two troeu, we simply 
compare the descriptions they «it. The trees are isomorphic if and 
only if the descriptions are identical, k problem which arises with 
this method is thai or.e ^re-e nay onit symbols fa&ter than another, 
but by organising additional cells into a variable length stack, 
such inequities in generation speed may be ignored, 

Saugdj car methcd i The final method of perforating the topological 
Batch might be called the squad car method. It is similar to the 
recursive method described, above, but is Bore highly parallel* It is 
in its simplest form lihen applied to the comparison of binary tress, 
so u* win consider this oase first. Let E 1 and E 2 be two rooted 
binary trees as in the figure on the following page.* 
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lh* caparison process goes as follows, A radio equipped squad 
car* S, will drive over toe branches of E 1 reporting over its radio a 
description of its route. Simultaneously a second ear, C, will begin 
to drive Over the branches Of 3 Z while listening on Its radio to the 
description of the route taken by 5* The car C will attempt to 
follow an isomorphic route, If C is successful * it will eventually 
arrive bee)! at the root of E and, the trees will have been proved 
isomorphic. If C is unsuccessful, it will, as we shall see, vanish 
sor.utft-.erE along its route and hence never return ts the root of B „ 

The route taken by S in driving OT»r B t la a simple right-hand 
turn method for traTftrsir.g a tree, Vhen S approaches a nod* of 
degree three from above, it leaves by the {free S's point of vi«w) 
right-hand branch. Upon returning to the node from below, S then 
takes the second descending branch* Upon return to the node again, 5 
leaves by the upper branch. Ihe path of 5 over B, is shown, in the 
diagram on the following page. 
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The de sOTT-pt ian whicfl S broadcasts is .is follows* Upon Bnr.arliijj 
a node for the first tojne frqm above » It broadcasts the nkimber of 
descending branches leading from the ncde (o» 1. or z)+ CH all 
subsequent visits* It simply broadeagtg (}]) to indicate that It has 
returned to a previous node* The complete sequence of symbols as 
broadcast by S when driving over B. would be 1» £» 1, ^ 0. !i, 0, Ii t 
H, H, 1, 0, N f If, H* (toe could use Instead a system of parentheses* 
but the system described above Is m-cre attuned ta tfle task at hand,) 

How let us follow our example as S tra verges B^ and C attempts 
to find am iacsDorpaic path in B^* 

.A 

t = 1 





At t ■ 1 both cars are about to begin and are sitting en the root 
nooks. S has a", ready transmitted its first report (1)* but it has 

not yet been received: by C. 
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Hy t = 2m C has recaiTed the 1 emitted '-■■ i= at t = t, has found 
its current path to he it; agreement with the 1, and both cars hav* 
advanced to the r.ext node* {We ignore for the moment the time it 
takes to transmit me a gageg and the tin* It takes to move from node to 
node*) S has transmitted a 2* When C receives the 2 W it will find 
that it is indeed sitting on a node of tee appropriate degraa. Which 
branch should it tak* a»j:t? k do te rain is tie car would gut fine choice 
and might wake the wrong ma, A non.~d.e-be minis tic car cculd be 
essuned to make the correct choice* Our car however is a parallel 
car and it maKes both choices w That is, it splits into tvru identical 
cars and each car takes a different branch l*ading from the node* 



- - 3 





^ST t - 3, S has moved, tc the next node and our allocating car C 
h-a? amoved dovn tc the nert two nodes. 
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By t = 4» S has arrived at a doubly branching nod* and has 
transmitted a 3. Both ccpies of C have advanced one node. VherL the 
left-hand copy of C receivaE the J., it will simply vanish flLnee it 
wili tnen be apparent that it ecu no longer follow a route similar to 
that followed by S, The right-hand copy of C will be In agreement with 
the Z t will again split, and vi.ll advance t* the next two nodes. 



t-5 




0-T^¥ 




Both copies of C will agree with the Q now being received and 
will attempt to return to the pre vl oils node. When a car splits, 
leaves a nods in two directions* and returns froo both directions. It 
indicates that both branches lead to isntnerphio subtree** die of the 
cars can simply vanish* leaving the other car to complete the process. 
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By t = 6, one car ramainp to continUH the processing 





By t ^ 7» C has descended a nods and is still in agreement with 
th* description being eiven bjr S. From here on out C will simply 
mirror the movements of £ and ttiB trees will bo found, to be isomorphic, 
The entire process has tsJcen tiae proportional to tha number of nodes 
In 6j» 

A point of interest is that the number cf distinct iacmorphlsms 
between two trees can be easily obtained from the abOYe method, Each 
time two ears return to a node and mer^e* a marker Is placed at that 
node in dice ting that tha two subtrees below are isomorphic.! If by 
tlie end of the process the trees turn out to be isoraorrihie^ thtm 
th^re wlii. be 2 71 distinct isomorphisms, , where n Is th* nuisber of 
Barked nodes* 

itfhon we cQmo to apply the squad ear method! of isomorphism 
chocking to the tree representations which hsve been generated frcm 
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figure?* we encounter two difficulties. First the trees are not 
binary*, but contain nodes of arbitrarily hl^h degree* Second the int^r- 
node ilistan-pes "fary widely. 

The problem of the existence of nodes >>f arbitrarily high degree 
t ■:■ easily overcome., '.-.hen & arrives at a new node, it must repcrt the 
degree of that node. In the binary case this could be don* oy Using a 
fixed set of symbol s r since Only thrift possibilities could arise* In 
the current case S can report the degree of a newly encountered node 
'n unary by driving along tiia loop (thinking in terras af a loop 
structure for a moment) on which the dependents of that nada are 
located and transmitting a "1" every time it passes a nade* When & 
completes its circuit of the loop and arrives back at the original 
node* it transmits an end of number signal* The degree of the 
corresponding node or nodes on which C is located is checked by having 
C traverse LhE corresponding loop or loops, advancing by on* nod* as 
each "1" ir> recEiveo* Any copy of which is not back at its starting 
node wh&r r the end of number signal arrives is on the wrong track and 
will, vanish. Provisions fs^r hind_ing ni^rLy c-jltipla slitting and 
recombination of C in B must a Is 6 be established. This can be 
accomplished by leaving appropriate markers at the nodes. 

The problem of varying distances between ncdes appears to be more 
serious in that the methods of overcoming it seem to boost the total 
time required for the process from something on the order of the path 
lengths of the trees to something en the order of the product of the 
patnlengths of the trees. Consider for a notsent what took place in 
the naive binary picture presented above. The squad oar s drove over 
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B 1 and transmitted a description of its rout*, Since s regeived no 

feedback from C t the rate at which S progressed was independent of 

any difficult!* a •nteuntfiFBd by C* In particular if S and C drive at 

the sartC rat*, than the branch lengths in B must be shorter on th* 

averse than th;-se in S or else C will beComs ovBrloadsd with the 

information transmitted by S. In the case of th* tr*e representations 

which we have generate a from figure 9+ there is no correspondence 

between branch lengths in B and in B • Cfie way of circumventing 

this difficulty is to allow the signals from 3 to pile up in a qu*u* 

at C. However* Z msves up and down within th* tree and there mav be 

multiple ccpi.es cf C present which nay be able to process th* signals 

from S at different rates. By the- tljcae th* »ov*m*nt and multiplicity 

of C has been accounted for* on* ends up with a process which is 

proportional to th* product cf th* path lengths cf B and B * 

1 2 

A stapler method which yields the same processing time Is to have 
5 wait for acknowledgement After each transmission, Thus; S makes a 
unary degree count and then waits for aa aeknowiedgflDaent from C, The 
signal sequence produced by S travel up the branches of B , across 
the communication pathway, and down the branches of EL T As the signal? 
travel down the branches of 9 ?i they split at each node cf degree 
greater than two and a copy gees down each deaaandi.'ig cranctw Sach 
copy of C will neceiTe the signals, process then, and send back an 
acknowledgement, "A", The "A" 1 a travel iap the branches of B*# When 
an *A a arrives at the node of degree greater than two, it waits for 
the remaining n k n f s to arrive from th* oth*r d* seen ding branches* 
When they have all arrived* they combine into a single "A"» whiah 
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then continues up the trae. It now becomes important that when a 
copy at vanishes, ecu* thing be left behind wnich can fltill 
aoi-rr.rjvle^Re signals, for otherwise no acktuj'wledgemuni would ever be 
■vmvr.; free-, a branch flora whisn i Z h.Ed "entered ;.,ti ±i.r:3|:: «3.^>d. 
His squad ear ftelhod As KOdified by unary degree counting and 
aeknowlsdg&ioent of transmission takes on the order of (p-n) to 
compare two H^n figures, Tha analysis is as follows, Tne amount of 
time spent ill notion by 3 and C is bounds d by a multiple of the path 
Iftnftths of 3,. and 3 « this tiia Is Small compared with the time 
spent by .5 waiting for acknowledgements. The number of times S waits 
for acknowledgement la proportional, to the number of ni;des in B^ which 
in turn B»y 0* proportional to n+n« The amount of time spent walling 
for a single aclmowledgectent i? prim.iri;.y a function c-f *„ne distance 
between 5 and the furthest (in terns of path length in the combinBd 
trees} copy of C* The latter distance may also be proportional to 

B-fl ¥ Thus the total time S spends waiting for aokncwled^emantE iR 

2. 
proportional to (m*n) ■ Of courae acme figure pairs may be found to 

oa non-isomcrpbin seen after the tree representations have been 

generated. Other figures however wlli tafce miih longer* 
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ihs jliagram 'below shows a type of flgiir*e whose tree repreja-ntAtion 
has 3 nUMbsr Of n&des proportional, **o (n-n) Hid * dspth (waaursd 
frctl Lhe root to the deepest notfe } proportional to (*-n). Such 
figures will mqulrB a long tiaie to cheak against sinilar figures* 
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CHAPTER 4 
HE SPLAY PROBLEMS 

fh& preceding two chapters dealt with the use of arrays a» 
devices whose input vis. a figure and whose output was a Sin file binary 
symbol* We- now study arrays as devices whose input is a fifnire and 
whose output is also a figure. 

"t t 1 Introduction 

If the arrangement of initial states In an array can be viewed 
as an input figu™» then by allowing the array to nm until every cell 
la in a final state, we may vl*w the arrangement of final states as an 
output figure. In this way an array or mere properly a call type may 
be viewed as a transformation from figures ever tne initial states 
into figures over the final states. An array operating in this node 
is said to be working on a dl splay problem . The following definitions 
formalize these concepts. 

Definition 

Given two sets I and T, a figure transformation 
(or transformation for short) , £T T of type I/F is 
a function from the set of figures over T into 
the set of figures over F, each that the image 
of an n*n figure is always an a*n figure* if 
F is a figure over I, we denote its image under 
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Divan a tranifcijfMtior. J and: a eg 11 type 
H, Hft say that M implements X if 

i) J is a transformation £ram figures ov*r 
ths set of initial state a of M into 
figures over thtf filial stages uS K 
ilj Given any nxr. computation fJ^ = {PpE 1 ,!^, - 
af type H ( Utare Exists an integer k such 
that C7 r <rPj = E^. 



Definition 



Divan a tranaf omati on [7" wa gay that it la 
cellular if there exists a call type M which 
implement a. it t 

DBflnltlat". 

If T(B t n} is a real-valued function, we say that H 
in piemen :.s JT within time ?[m.n> if X inplsaant.R 7 
and for avsry **n computation £l= if,!? 1 ^, „■ 
there #jasts an. integer It such that ~J(,lP) = t^ 
and. it $ T(n h n)» 

If thsre exist int&g&r* p, q, r such that M 
lmplftttsnts J within tiLeie .pa + on + r* we say 
that J is Linear , 

Many of the theorems on r&COgnition such as Theoren Z.% the 
Minimizing iheoraB, have innaddlaLa analogs for display* Since nothing 
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really new is contained In these analogs* wa will emit "than. The 
5peed-Up Theo^aan however I* slightly different in form in the case cl 
disp?.ay» 

theorem q-*t (Speed-Up) 

Let iT be a tr.:insf dilation and let M be a cell type 
which Lcipioments J within tine T(m*n3, Than given 
any positive irtegai* k f there exists a cell type M 
which implement g J within 

J'(T(iq f n)) +2(1 + l)<in + n) - U 

PROOF) As in Thee rem 2 + 2 and Corollary 2-2,1* we perform packing 
followed by spoeded-up sim.ul.'i-i-n. According '.» Corollary 2.2,1, we 
will nave all simulated cells in their final states by time 
t = m + 

Unlike the recognition case where no mere remains to bo done p we 
must, in the case of display* unpack 'he results ao that the output 
figure can be displayed by the array*. 

Unpacking may begin as soon as all the simulated cells nave 
entered their final states. If it were the case that all the 
atmulited cells entered their final state at the same time h we could 
begin unpacking at that time. However* since different Cells may 
rr<ter final states s.x, different lines* we need a method of deciding 
when the last cell has entered its finai state. This is done by 
having a module generate a completion signal as goon as all of the 
cells It is simulating have entered their final states. Tne 
completion signals originating on the southern edge of the packed 

121 



D _[j]_[g] + [jfa*^!] +fc 



portion of the imy flow to tha north in the sol™n in which thay 
originated. If a signal arrival at a Eodula, all of vhoa* Simula ted 
sails hav* not entered final states, it waits until they do enter 
final state a before continuing, Thus when a completion signal arrives 
at a module on the northern edge* It signifies that all of the 
simulated colli in that ooluwj are in final states. In a similar 
manner each nor thorn sdga module passes the eempletion signal on to 
its western neighbor as soon a a it receives completion signals frcm 
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its southern and eastern neighbors, Ihua in no mere than 

units after the last simulated cell has entered its final state, the 

northwest comer module will be aware of this fact. It can then 

initiate a two-dimensional firing s^uad in tha paokBd portion Df the 

array* When the firing squad gees off, the unpacking will begin. 

Assuming that tha firing squad, takes 2£[¥| * |~ j ) - u units to go off* 

tha unpacking operation will ge-., under way no late;- than 

t = id + n + 2(h + (!) - 2 + |"T(n,n) - \1 w f WB wilx w i,, 

Section k that this firing squad time can be improved slightly*) 

The unpacking process is quite siEple and is illustrated on the 
following page for a 5*5 case with ft * 2. 
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The unpacking process- takes m +■ fl steps* {Hots information can be 
packed faster thin it can be unpacked.) Thus the entire simulation 
fron the beginning of packing to the end of unpacking takes 
2{m + n+rj5]*[Y|- 1) ^ pt' l gM J^^TCl,!!) +X 
steps. 



1 + i)<]a + n) - 2 
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We also- have by a simple c en a traction 



Theorem 4*2 



The cemps-sitien af cellular (linear) trsntifennati ens 
i& sl cellular (linear) transformation. 
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4.2 Specific Problems 

In this flection wfl Kill CGnsidHr s,oua specific figure tranafor- 
pations and their implementation by iterative arrays* Ecm* 5f these 
transformations are included because they iire frequently proposed by 
pecple who are hearing about itarativa arrays for the first time. 
Other* ha vs. been Included becaua* thay seen-, to be in teres; ting trana- 
forna tiona vhose linearity ia still open. Tft* discuislcna are briaf 
and informal. 

Tne first set of transformations we Ec^sider are acme simple 
geuzstric tran a f ormati i« s of black and white figures Which are 
usually proposed as "problems* by persons who are experiencing 
iterative programming for the first tint*, They are all linear 
transformations! 

This tranafannation is the result of translating the 
input figure rigidly to the vest so that th* WBsrtErn- 
aost black coll in the figure lies on the western 
edge of the array t 
Example i 
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^_ Jir . na-y be Implemented in linear time as foil ays: 
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1) The figure casts a ahedow downwards «itc the 
a cut-hern edne« 

li) The westam^mest p&int of the shad™ la detected 
and: a line is drevgn to trie northern edge from this 
point. The figure has now been enclosed in a 
block of cells and is tangent to the we stern, edge 
of the block, 

iii) Using shifting techniques similar to those used 

in packing ar.d unpacking figures for speed-up { see 
Theorems 2.2 and ^.1), shift the block to the west 
so that it is tar-gent to the wests m edge. 

■J m (ROTATE) 

This transformation applies ORiy to square (e = n} 
array a, Tbe transformation is the result of ™tating 
the input figure about its central point by ^c" counter* 
clocKwise, 

Example : 
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First observe that a holicv square of cells can shift 
the Information it contains by PC" counterclockwise ±n 
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time proportional to the edge of the square* Such a 
shift is indicated below* 
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Then J^. nay ne inplemented in linear tine by first 
organizing the array into a set of concentric hollow 
squares ana than having aSch hollow square shift its 
information by 9Q a otMnterclMJnri.se. 
One might ask for rotations of other ihan Multiples of 90** A 
aa.Tor difficulty then be ceases the question of just what the result of 
auqn a transformation should be. This tiuftstifcn in t.irn leads to the 
area of approjciltatlon techniques far figures which Is Outside the 
scops of the ourrent vorfc. 

This transformation causes a dilation of the figure toy 
a factor of n about the center point of the array, vhera 
n ia a positive intBgGr or the reciprocal of a positive 
irtERer. If n is greater than 1, the figure enlarges; 
if n is lesa than l r the figure contracts. 
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<J t . May bo implemented in linear time as follow*: 
i) "The Center poin^ oi the array is deteiraint! d and 

each coll determines which of the faur rectangular 

quadrants It lias In, 
ii) The parti nn cf the figure within each a.uadrant is 

dilated by a factor Of H* either away frran er toward 

the central point, 
the process of expanding Dr contracting a quadrant ta 
similar to the process of packing or unpacking for the 
purpose of speed-up as described; in the proofs of 
Theorems 2 r £ and 4.1 ■ wTien exp&JKtirtg by a factor of k, 
each Cell In th* quadrant pretends that it is a Kodule 
In which ft k-k block of cells has been packed, The 
color of these cells is- taken to be the color or -Jne 
aodule* When the cells; have been unpacked, they will 
cover a k»k area in the figure* That is. the original 
cell will have expanded by a linear factor of k* The 
process oJF a contraction la similar. After a k*k block 



137 



of calls has been packed into a modulo* that module takes 
on a color which 1b determined by the colors, of the cells 
packed within it. In this case one has to fix a rule which 
determine a the color of the module as a function of the 
colors of the cells. Three such rules are [1} the nodule 
turns black if all the cells are clack and white otherwise , 
(2) the module turns black if any of the cells are black 
and white otherwise , and (3) the module turns black if 
m-ur* than half of the cells are black and white otherwise, - 

In Carrying out a ccatrac-ulcn. One always has enough I'oom \h the 
array to represent the linage of the transformation. In carrying out 
an expansion, horaviar, there nay not be enough room in the amy to 
contain the resulting fif^ire. (Vhen we say the array contains the 
resulting figure, we of ccurse mean that the array contains all the 
black cells in the resulting figure,) We may siaply truncate the 
entpan-ded figure at the boundary of the array or we may use the concept 
of folding to preserve the entire expanded figure fwr further proces- 
sing, although it cannot be displayed* Consider the similarity in. 
structure between a piece of paper which ha^ been folded in half 
once with the fold on the left and an iterative array of two layers 
in which we think of the layers as being connected raly at the 
was tern edge* If the array has dimension n*n, we have in effect an 
array ef dimension n*2n which has been folded over once. This ±b 
the concept of folding . B? yatns Pi°re layers* more can plica ted 
folding nay be simulated. In particular, siven any posiT.lv-e integer 
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k, we may design an array which, by using folding, acts as though the 
Initial figure is centered on an an-a^ of size km*kn + Thus given any 
positive k r ve may das foldinf to design a call type which can expand 
any input f igura by a factor of k although it cannot display that 
figure in the usual sense* Finally givien any positive rational 
number, c_, we may perform a dilation by s, factor of q by first 
expanding by the numerator and then contracting by the denominator. 

The next set of transformaticns to be considered axe known to be 
solvable in time proportional to m-n, but their linearity is open.. 

This transf carnation accepts black and whits figures and 
produces a figure *hich has the same number oH black 
cells, but ill which these eell@ are packed into solid 
rows at the top of the figure. 
Examples 





Wf. 



in 



EULER 



There are several simple waye c.f achieving this packing 
in time proportional to am. We will leave them for the 
interested reader to discover. 
The packing transformation is related to the recognition of 
which was defined in Section 3.5* Tha recognition of that 
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predicate had bean reduced to detenaining whether there ware siore 
+1's than -4 f s distributed about the array. If ■J n , f%v la linear, 
tijftr, in linear time the *1's could fee packed in ana layer* the -1 's 
in another layer* and the majority determined* Thus the linearity of 

^PAOC jjrpl±es " jt:e lij iBRrity of ^auiER* Ifc WDui ^ ai?D **Ply the 

linearity of ¥ t defined to be tho set Of ail black and while 

HUGH. 

figures which have mora black than white cell*. Currently the 

linearity of t is still open. 

BLACK 

J^p (HEFflESEHTATIVE) 

The problem is to transform a. black and ubite figure 
into a b^agkj red* and white figure by turning exactly one 
tall of each component cr hole red. This transformation 
thus corresponds ta the process of selecting a represent- 
ative cell fTOffl each hole and component. The tree generation 
process described in Section y m 6 can be easily modified 
to produce a solution to tne representative problem,, The 
linearity of this problem ia open. attempts h.ava '.'ean 
made to adapt the connectivity transformation to this 
problem i but without success* 

Hcte: In the above problem a a in the foil wing two we do not 
actually specify the transformation in complete detail. Instead we 
indioate some general properties which the transformation aust have* 
For exuaple in the problem above we do not care which cell in a given 
component turn a radi ao long as exactly one turns red* The problem 
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is to find a cell type which impleaenta in linear "time a transformation, 
having the properties given. 

X {SHORTEST PATH) 

Given a eolvable lisase, draw a shortest path solution to 
the mCLBe in red. Thacrem 3*4 state* that solvable waaes 
can be recognized in Linaar tijmo. Here we a ah that a 
Shortest path solution, bo displayed in linear time* Wo 
night be less ambitious and ask can any solution to the 
naze be displayed in linear ^ime t aince this problem is 
open also* A solution to the shortest path problem can. be 
obtained in time proporti ona 1 to m*n by a simple 
adaptation oi 1 the contagion process described in 
Section. >,6. 

jf ap (COLD HATE) 

Given a black and white treasure map (black islands in 
white water) an which is indicated the location of a 
che&t of gald {by a gold cell}, display the nap obtained 
by coloring gold the entire island on which the gold is: 
located* {Or equiTalently erase aii islands on which 
the gold la not located*) This process is easily carried 
out in tire proportion^; to r.-n by a contagion process. 
Its linearity is open. 
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4-* 3 Two- Dimensional Firing Squad 

In this section w* consider a two-dimensional analog of the well- 
Imowi firing squad synchronization proble« t (S*a Section 1*3. J This 
problem is strictly speaking not a display problem, but is more related 
tc display than recognlti on, se we have Included it In this chapter* 
As has bean seen in the ]ircof of Theorems 2.2 and ^*1 t a solution to 
th9 firing squad problem is a useful tool in solving other iterative 
&xray problem s t 

The two-dimensional firing squad problem may he stated as 
follows* Stsign a tell type I* such that the following conditions 
hold; 

I) Tne initial states of H are g {general) and a 
(soldier). 

II) The final stabs of K is f (fire). 

iii) The soldier state is dormant relative to soldier 
and edge states. That is 



c|s 



g *|i 



•It 



tla 



w S 



where | is the transition function and 6 Is ra presents 
either an edge state or a soldier state, 
iv) O/Lyba any n*n array of type X in which the initial 

configuration consists Of One cell in the general 
state at location (1,1] and a Li other cells in the 
soldier state, then there exists an integer k 3ttoh 
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that all cells- enter state f for the first tizio 
at t = k« 

A thorough discyggicm of this- problem for the ease where tit = 1 Is 
given in o^lser^ where he proves the existence of an eignt state 
solution (nine state solution in our foinna-Lsn) in uhleh the ^c.diers 
fire at tine t = 2n - 2, This solution or any solution %o the one- 
dimensional case may be used to construct a solution to the two- 
dimensional problem a a fallows, A firing squad activity is orgsni'sad 
In row 1 of the array by the general in cell (1 P l). At time 2n - 2 
each scldler in row t instead of entering the firing strjte, becomes a 
general* (Otae of the largest and moat drastic field pr auctions in the 
annals of military history, ) These new generals* together wi-.b the 
old general, now organise firing equad activity in their respective 
columns, Since this activity begins in each column at the sane time 
(t - 2n -« Z) and since the columns are all of length in* we have that 
the entire array will enter the firing- state at time 

t ■ 2n - 2 + 2m - 2 ■ 2(n + n) - fc. 

The solution to the two-dimensional firing squad pJtfblem which 
was pre sun tad in the previous paragraph is not optimal in terms of 
time* Before considering a faster method* let us find a lower bound 
on the time required for a solution. 

ThBoreg. ^._3 

Any solution to the tvo-dimensional firing squad 

problem will require at least 3 + n + max {ra.nif - J 

units of tima to enter the firing state on an m*n 

array, 
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FTCDOFi Let a, it bs given and assume without loss of genei-aUty that 
n^ffl,. We wi,ll show that call (Urn) cannot lire before time 
t = m + 3n - J. Ths idea is quit* simple* Cell {1 ,m} cannot fine 
before it learns of the existence of the eastern edge Df the arr*y. 
The aaount of ttflte It takes 4 signal to travel £rm the general to 
the eastern edge and return to cell (1,») is a + 2n - J. 

A none formal proof may be given using diagram and the 
iii Lcrdeper.. ?&;-.cr : Tne^^wa, tat L:j:j i:ie,-=. i.~ T_-.? s.ifcS. 

Wb urn find that the lc^er bound giYen a'soire is attainable. 

.Theorem t*.u 

There axistB a solution to the two-dimensional 
firing squad problem which enters the firing 
state at t = m + n .+ max |ra»n } - 3* 

?HOGF: Moore and Langdon^ ' dsmonstrats ths existence of a 

seventeen sta^e solution to what they temi the generalised firing 

squad problec. This is a one-dimensional firing squad in which the 

general is located net necessarily at one and of the line of soldiers, 

but somewhere in the Kiddl*i If MS bend such a line of soldiers by 

90* at ths general's location, we end up with an L-shapod firing 

squad as in the following diagram* 

ft n f| 

[ s ] s s s i i b a t] 



i 

m 
it 



1* 



Kdo« and Lan4don r * solution d expressed in tenns of m and n wi]J. 
cans* til* soldiers to fire at tine t = m + n + max {«.n| - 3* 
Sou cOniidar an n»1 arr&y w-hioh has been partitioned into a set of 
L-ahaped components as in the diagram below. (Assume n^-m,} 

















IT" 




I r— ~ 



"?/e will sat up a Xoore a -,d LangdOh -Solution to the firing squad 
orc-blam in each of these L r s» Sotic* that the corners of the L's lie 
in a diagonal line. The comer coll In the largest L knows it is a 
general at time t = and can begin activity at once, A signal is 
Hade to propagate down tne diagonal at the rate of On* diagonal Cell 
every three units of tiiqe, As the signal strides each soldier on iLhe 
diagonal, he becomes a general and initiates firing squad activity in 
his L* Thus the 1 whose general is in row i will begin activity at 
time t = 3i - 3 and hence will fire at ^ime 

t * 3i * 3 + (h - i + 1) + 2(a - i + 1) - 3 = ■ + £n - 3* 
That is all cells in the array will fire at the sane tine, 
t = m +■ 2n - J* LI 

Letting n = n t we find that the above solution will cause th# 
cells of a square array to fire at tirae t = 3 11 - 3» which is minimal 
by Theoror. ^.3. Suppos* however w* ask for a solution to the firing 
squad problem which works only ori square arrays » That is, we don't 
ear* what it does on arrays which are not square . Then it turns 
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out that we -San obtain a solution in time 2ji - 5 by using ihs game L 
partitioning Kovaver Instead of treating the entire L as a Moore and 
Langdon firing squad* we treat each half as a Salsa r firing 1 squad* 
In addition we initiate the squad In row 1 at time 2i - Z rath&r thar 
31 - >* This result yielding a tin* of 2n - Z for a square {which is 
pravably the best possible) was discovered in parallel by the jnura'&trs 
of Seymour Xpert's Glass at H. I. T. 
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